-- Logs begin at Wed 2021-09-08 15:25:55 UTC, end at Wed 2021-09-08 16:40:13 UTC. -- Sep 08 16:05:35.897411 dv-cinder-807898-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 8 16:05:35 2021] *** Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: nodename: dv-cinder-807898-1-iscsi Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: machine: x86_64 Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: clock source: unix Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: pcre jit disabled Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: detected number of CPU cores: 4 Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: current working directory: / Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: detected binary path: /usr/bin/uwsgi-core Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: your processes number limit is 47680 Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: your memory page size is 4096 bytes Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: detected max file descriptor number: 2048 Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: lock engine: pthread robust mutexes Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: thunder lock: enabled Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 16:05:35.910774 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 08 16:05:35.951426 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: Python main interpreter initialized at 0x55be6a3fb9c0 Sep 08 16:05:35.951426 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: python threads support enabled Sep 08 16:05:35.951426 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: your server socket listen backlog is limited to 100 connections Sep 08 16:05:35.951426 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: your mercy for graceful operations on workers is 90 seconds Sep 08 16:05:35.952008 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 16:05:35.952008 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: *** Operational MODE: preforking *** Sep 08 16:05:35.952152 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: *** uWSGI is running in multiple interpreter mode *** Sep 08 16:05:35.952152 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: spawned uWSGI master process (pid: 78744) Sep 08 16:05:35.952382 dv-cinder-807898-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 16:05:35.953018 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: spawned uWSGI worker 1 (pid: 78745, cores: 1) Sep 08 16:05:35.955826 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: spawned uWSGI worker 2 (pid: 78746, cores: 1) Sep 08 16:05:35.955826 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 16:05:40.141401 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 16:05:40.142225 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 16:05:40.142225 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 16:05:40.142485 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 16:05:40.142734 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 16:05:40.143127 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.143452 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.143806 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.144125 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.144455 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.144757 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.145079 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.145401 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.145725 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.145993 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.146346 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.146648 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807898-1-iscsi {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.146973 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.147278 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.147615 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.147934 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.148264 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.148561 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.148870 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.149375 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.151217 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.151217 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.151217 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.151217 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.151217 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.152024 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.152024 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.152024 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.152499 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.152673 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.152849 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807898-1-iscsi {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.153170 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.153481 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.153908 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.154541 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.155421 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.155421 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.155814 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.155814 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.156129 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.156416 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.156733 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.157057 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.157370 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.157667 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.157975 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.158285 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.158592 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.158900 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.159200 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.159452 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.159786 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.160126 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.160423 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.160744 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.160996 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.161247 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.161562 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.161881 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.162195 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.162502 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.162808 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.163112 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.163416 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.163745 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.164051 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.164358 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.164676 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.164991 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.165311 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.165617 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.165932 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.166336 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.166597 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.166892 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.167230 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.167576 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.167885 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.168201 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.168522 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.168828 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.169136 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.169438 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.170282 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.171041 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.171213 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.171441 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.171775 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.172085 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.172409 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.172717 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.173024 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.173329 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.173632 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.173936 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.174241 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.174546 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.174850 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.175155 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.175457 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.175786 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.176093 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.176397 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.176733 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.177028 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.177333 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.177635 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.177940 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.178247 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.178565 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.178870 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.179219 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.179555 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.179818 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.180123 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.180437 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.180743 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.181050 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.181367 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.181665 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.181970 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.182292 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.182597 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.182902 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.183206 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.183529 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.183842 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.184143 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.184431 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.184740 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.185030 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.186141 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.186924 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.187138 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.187410 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.187747 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.188074 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.188412 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.188743 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.189086 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.189456 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.189762 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.190091 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.190411 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.190719 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.191033 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.191355 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.191696 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.192008 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.192318 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.192642 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.192959 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.193283 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.193597 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.193952 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.194336 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.194531 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.194820 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.195146 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.195465 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.195796 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.196137 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.196477 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.196791 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.197114 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.197426 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.197747 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.198059 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.198371 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.198677 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.198992 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.199305 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.199689 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.199967 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.200287 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.200600 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.200934 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.202033 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.202033 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.202033 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.202625 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.202625 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.202989 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.203204 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.203412 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.203753 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.204065 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.204483 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.204686 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.204969 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.205277 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.205579 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.205901 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.206208 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.206509 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.206829 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.207130 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.207431 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.207809 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.208109 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.208420 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.208728 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.209050 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.209361 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.209840 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.210047 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.210315 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.210619 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.210940 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.211261 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.211619 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.211923 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.212236 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.212528 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.212832 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.213132 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.213440 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.213739 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.214110 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.214345 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.214716 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.214920 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.215250 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.215578 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.215882 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.216185 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.216513 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.217040 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.217984 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.217984 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.217984 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.218575 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.218575 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.218961 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.218961 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.219343 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.219619 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.220007 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.220225 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.220472 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.220776 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.221083 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.221400 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.221728 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.222032 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.222348 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.222666 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.222972 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.223277 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.223609 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.223912 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.224212 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.224518 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.224883 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.225131 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.225438 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.225738 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.226047 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.226349 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.226650 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.226949 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.227255 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.227604 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.227910 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.228228 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.228544 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.228845 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.229147 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.229464 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.229772 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.230171 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.230383 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.230653 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.230993 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.231302 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.231619 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.231937 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.232790 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.233305 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.233305 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.234255 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.234255 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.234647 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.234844 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.235196 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.235394 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.235939 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.236258 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.236569 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.236890 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.237199 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.237506 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.237813 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.238115 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.238421 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.238738 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.239320 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.239677 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.239993 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.240377 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.240622 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.240940 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.241265 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.241594 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.241901 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.242207 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.242510 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.242821 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.243122 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.243432 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.243760 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.244068 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.244372 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.244680 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.244984 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.245330 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.245587 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.245992 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.246306 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.246609 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.246919 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.247221 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.247566 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.248473 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.249583 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.249583 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.249583 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.250180 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.250180 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.250804 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.250804 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.251202 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.251202 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.251615 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.251868 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.252174 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.252477 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.252792 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.253098 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.253401 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.253711 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.254032 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.254341 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.254641 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.255058 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.255536 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.255747 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.256000 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.256304 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.256609 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.256913 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.257221 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.257524 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.257841 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.258149 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.258453 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.258760 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.259061 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.259366 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.259698 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.260021 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.260334 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.260677 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.260940 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.261243 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.261547 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.261850 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.262157 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.262457 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.262765 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.263065 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.263395 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.264513 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.264513 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.264513 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.265099 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.265099 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.265498 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.265498 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.266033 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.266224 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.266441 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.266757 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.267078 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.267393 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.267729 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.268043 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.268345 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.268658 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.268964 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.269274 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.269577 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.269880 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.270196 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.270510 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.270882 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.271130 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.271452 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.271793 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.272147 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.272456 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.272773 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.273081 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.273388 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.273698 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.274010 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.274319 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.274629 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.274941 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.275250 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.275581 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.275953 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.276196 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.276503 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.276825 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.277133 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.277435 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.277742 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.278044 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.278353 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.278654 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.279124 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.280306 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.280306 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.280306 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.280831 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.280831 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.281314 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.281314 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.281700 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.281938 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.282253 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.282570 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.282880 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.283182 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.283515 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.283820 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.284141 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.284447 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.284750 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.285051 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.285370 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.285676 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.286117 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.286406 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.286716 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.287018 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.287429 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.287765 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.288075 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.288394 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.288714 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.289036 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.289340 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.289657 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.289964 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.290286 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.290602 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.290913 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.291253 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.291545 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.291870 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.292191 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.292509 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.292829 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.293246 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.293569 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.293878 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.294202 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.294525 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.296155 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.296155 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.296155 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.296850 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.296850 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.297245 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.297452 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.297764 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.297964 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.298162 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.298462 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.298768 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.299089 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.299394 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.299741 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.300054 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.300376 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.300698 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.301002 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.301405 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.301618 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.301916 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.302218 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.302531 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.302870 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.303172 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.303505 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.303911 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.304237 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.304547 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.304880 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.305204 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.305519 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.305838 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.306162 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.306538 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.306749 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.307060 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.307365 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.307704 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.308009 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.308315 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.308616 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.308917 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.309222 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.309542 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.309840 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.310159 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.311137 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.312144 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.312144 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.312144 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.312731 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.312731 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.313109 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.313311 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.313620 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.313938 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.314251 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.314575 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.314893 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.315210 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.315546 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.315863 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.316181 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.316499 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.316849 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.317104 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.317421 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.317735 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.318052 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.318626 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.318955 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.319271 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.319610 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.319923 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.320242 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.320555 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.320867 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.321176 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.321485 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.321795 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.322203 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.322426 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.322759 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.323101 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.323418 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.323764 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.324079 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.324397 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.324760 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.325082 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.325388 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.325730 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.326060 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.327142 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.327142 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.327142 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.327905 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.327905 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.328272 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.328486 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.328717 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.329035 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.329368 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.329708 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.330028 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.330340 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.330647 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.330966 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.331571 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.331878 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.332233 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.332585 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.332854 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.333170 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.333487 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.333816 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.334126 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.334435 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.334750 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.335059 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.335362 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.335747 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.336062 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.336371 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.336691 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.337000 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.337566 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.337914 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.338257 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.338552 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.338875 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.339190 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.339539 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.339842 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.340145 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.340448 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.340762 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.341074 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.341374 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.341713 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.341713 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.341713 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.343254 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.343254 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.343254 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.343829 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.343829 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.344197 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.344411 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.344725 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.345029 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.345333 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.345637 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.345941 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.346247 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.346552 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.346858 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.347160 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.347522 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.347866 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.348084 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.348379 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.348704 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.349010 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.349311 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.349635 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.349943 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.350264 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.350571 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.350880 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.351226 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.351563 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.352146 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.352479 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.352795 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.353131 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.353463 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.353767 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.354071 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.354377 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.354698 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.355007 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.355315 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.356001 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.356325 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.356644 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.356959 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.358767 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.358767 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.358767 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.359350 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.359350 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.359790 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.359995 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.360248 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.360566 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.361137 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.361451 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.361760 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.362070 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.362387 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.362721 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.363034 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.363387 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.363785 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.364099 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.364419 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.364740 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.365049 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.365376 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.365735 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.366062 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.366388 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.366692 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.366998 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.367302 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.367642 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.367990 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.368325 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.368684 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.368960 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.369292 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.369608 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.369920 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.370230 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.370538 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.370849 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.371169 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.371540 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.371827 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.372140 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.372464 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.372840 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.374414 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.374414 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.374414 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.374997 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.374997 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.375517 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.375719 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.375941 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.376282 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.376604 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.376914 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.377237 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.377557 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.377884 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.378194 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.378528 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.378907 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.379142 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.379454 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.379796 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.380098 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.380406 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.380735 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.381058 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.381365 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.381687 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.382002 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.382329 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.382643 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.382949 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.383271 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.383613 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.383989 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.384222 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.384536 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.384845 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.385159 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.385482 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.385804 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.386131 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.386450 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.386800 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.387112 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.387452 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.387807 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.388048 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 16:05:40.404102 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 16:05:40.405923 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 16:05:40.405923 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 16:05:40.405923 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 16:05:40.405923 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 16:05:40.405923 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.406539 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.406539 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.406734 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.407095 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.407285 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.407637 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.407956 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.408286 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.408539 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.408862 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.409181 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807898-1-iscsi {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.409499 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.409814 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.410115 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.410430 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.410729 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.411048 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.411347 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.411898 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.412198 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.412499 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.412803 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.413144 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.413446 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.413756 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.414068 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.414373 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.414691 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.414998 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.415313 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807898-1-iscsi {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.415657 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.415970 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.416278 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.416690 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.416991 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.417299 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.417617 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.417934 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.418239 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.418561 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.418879 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.419192 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.419522 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.420523 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.420997 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.420997 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.421255 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.421551 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.421851 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.422099 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.422402 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.422720 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.423033 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.423352 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.423619 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.423868 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.424187 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.424497 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.424800 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.425102 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.425406 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.425706 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.426004 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.426306 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.426612 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.426908 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.427225 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.427557 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.427878 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.428179 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.428492 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.428898 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.429146 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.429446 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.429781 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.429996 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:40.430091 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.430379 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.430692 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.431007 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.431318 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.431641 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.431944 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.432256 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.432570 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.432868 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.433113 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.433411 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.433709 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.434021 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.434316 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.434611 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.434912 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.435227 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.435595 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.435898 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.436199 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.436548 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.436926 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.437229 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.437531 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.437832 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.438131 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.438569 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.438759 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.439059 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.439355 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.439679 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.439982 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.440295 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.440595 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.440891 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.441206 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.441507 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.441803 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.442114 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.442413 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.442712 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.443021 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.443315 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.443637 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.443950 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.444251 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.444549 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.444847 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.445145 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.445442 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.445740 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.446034 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.446332 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.446624 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.446935 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.447248 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.447572 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.447891 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.448173 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.448485 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:05:40.448824 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.449149 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.449487 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.449797 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.450121 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.450447 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.450763 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.451758 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.452056 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.452378 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.452689 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.452997 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.453306 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.453622 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.453935 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.454257 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.454567 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.454876 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.455188 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.455522 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.455831 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.456152 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.456466 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.456772 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.457105 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.457440 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.457748 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.458065 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.458367 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.458690 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.458998 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.459307 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.459636 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.459952 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.460259 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.460565 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.460898 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.461213 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.461525 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.461829 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.462130 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.462430 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.462734 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.463033 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.463349 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.463696 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.464003 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.464400 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.464641 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.464947 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.465256 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.465560 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.465869 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.466177 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.466518 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.468115 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.468115 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.468115 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.468540 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.468696 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.468949 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.469260 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.469567 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.469877 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.470183 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.470502 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.470813 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.471121 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.471454 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.471802 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.472104 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.472424 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.472745 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.473059 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.473360 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.473667 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.473970 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.474268 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.474570 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.474877 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.475176 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.475512 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.475793 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.476093 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.476393 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.476711 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.477017 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.477317 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.477616 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.477914 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.478252 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.478559 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.478893 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.479203 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.479547 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.479868 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.480176 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.480472 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.480773 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.481079 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.481400 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.481699 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.482011 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.482362 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.483239 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.483239 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.483543 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.483726 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.483918 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.484239 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.484547 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.484855 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.485162 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.485462 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.486028 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.486334 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.486644 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.486950 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.487256 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.487584 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.487895 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.488198 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.488502 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.488800 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.489105 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.489422 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.489725 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.490040 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.490355 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.490653 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.490954 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.491270 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.491600 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.491901 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.492204 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.492507 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.492848 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.493154 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.493458 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.493774 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.494092 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.494396 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.494713 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.495019 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.495323 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.495674 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.495984 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.496288 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.496596 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.496902 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.497208 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.497513 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.497871 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.498177 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.499062 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.499062 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.499062 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.499517 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.499676 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.500262 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.500590 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.500902 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.501218 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.501531 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.501843 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.502167 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.502486 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.502797 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.503098 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.503405 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.503731 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.504033 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.504337 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.504638 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.504939 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.505235 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.505540 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.505840 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.506139 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.506438 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.506736 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.507045 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.507345 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.507678 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.507977 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.508304 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.508608 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.508911 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.509209 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.509508 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.509848 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.510150 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.510483 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.510805 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.511139 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.511440 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.511765 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.512085 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.512386 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.512686 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.512995 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.513297 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.514436 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.515229 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.515229 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.515229 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.515657 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.515856 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.516157 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.516473 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.516774 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.517078 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.517377 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.517685 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.517993 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.518293 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.518620 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.518928 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.519227 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.519564 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.519868 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.520168 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.520476 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.520795 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.521110 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.521408 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.521718 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.522019 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.522324 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.522623 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.522926 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.523224 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.523545 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.523846 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.524145 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.524443 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.524761 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.525065 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.525365 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.525663 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.525963 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.526301 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.526603 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.526954 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.527256 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.527597 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.527918 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.528226 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.528539 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.528846 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.530069 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.530469 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.530469 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.530820 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.531204 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.531531 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.531862 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.532170 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.532476 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.532795 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.533117 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.533433 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.533736 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.534046 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.534351 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.534660 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.534967 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.535275 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.535614 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.535926 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.536234 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.536540 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.536849 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.537156 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.537463 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.537767 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.538066 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.538395 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.538696 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.538996 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.539303 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.539636 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.539949 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.540249 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.540687 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.540995 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.541303 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.541607 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.541926 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.542231 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.542545 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.542857 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.543156 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.543603 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.543917 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.544224 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.544533 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.544891 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.545230 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.545541 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.545868 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.546157 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.546459 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.546759 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.547079 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.547388 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.547729 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.548152 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.548470 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.548776 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.549186 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.549492 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.549802 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.550125 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.550444 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.550763 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.551066 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.551382 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.551713 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.552034 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.552353 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.552664 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.552978 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.553279 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.553601 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.553920 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.554227 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.554546 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.554961 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.555277 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.555608 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.555931 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.556250 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.556553 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.556852 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.557159 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.557461 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.557765 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.558082 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.558387 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.558694 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.558999 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.559303 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.559629 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.561108 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.561108 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.561667 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.561667 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.561944 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.562255 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.562572 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.562874 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.563191 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.563536 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.563825 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.564127 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.564429 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.564767 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.565065 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.565380 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.565704 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.566031 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.566334 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.566662 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.566985 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.567296 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.567633 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.567958 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.568259 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.568568 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.568874 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.569180 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.569482 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.569782 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.570087 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.570388 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.570691 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.570993 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.571311 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.571643 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.571963 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.572273 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.572576 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.572878 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.573180 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.573518 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.573944 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.574315 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.574638 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.574958 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.575285 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.575624 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.576548 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.576929 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.577180 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.577496 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.577809 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.578121 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.578440 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.578753 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.579060 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.579377 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.579714 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.580030 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.580607 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.580936 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.581247 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.581629 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.582196 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.582771 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.583334 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.583749 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.584067 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.584383 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.584697 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.585034 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.585545 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.585945 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.586579 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.587153 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.587773 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.588361 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.588957 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.589621 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.589956 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.590272 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.590601 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.590930 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.591275 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.592413 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.592958 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.593373 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.593602 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.593929 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.594247 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.594567 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.594886 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.595230 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.595886 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.596495 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.597003 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.597326 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.597901 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.598487 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.598807 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.599150 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.599496 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.599830 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.600148 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.600467 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.600797 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.601104 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.601411 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.601724 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.602031 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.602363 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.602662 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.602973 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.603277 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.603632 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.603944 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.604508 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.604861 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.605314 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.605660 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.605989 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.606309 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.606618 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.606943 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.608144 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.608144 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.608608 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.608852 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.609101 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.609408 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.609722 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.610031 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.610337 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.610647 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.611216 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.611576 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.611885 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.612189 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.612591 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.612930 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.613235 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.613538 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.613842 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.614148 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.614458 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.614761 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.615149 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.615551 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.616012 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.616468 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.616893 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.617209 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.617548 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.617859 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.618168 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.618495 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.618807 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.619137 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.619451 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.619951 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.620466 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.620856 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.621444 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.621775 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.622095 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.622447 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.622824 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.623135 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.623455 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.623938 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.624418 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.624802 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.625113 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.625426 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.625737 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.626047 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.626354 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.626891 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.627202 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.627537 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.627855 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.628209 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.628528 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.628845 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.629168 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.629524 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.629982 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.630433 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.630853 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.631169 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.631512 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.631853 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.632173 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.632484 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.632942 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.633357 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.633686 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.634008 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.634320 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.634653 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.635007 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.635332 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.635698 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.636000 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.636306 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.636610 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.636920 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.637264 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.637601 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.637926 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.638460 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.638683 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.638943 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.639256 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.639596 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.639912 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.640221 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.640541 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.640859 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.641178 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.641493 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.641817 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.642128 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.642447 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.642747 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.643061 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.643368 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.643709 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.644043 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.644356 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.644675 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.644985 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.645305 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.645614 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.645933 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.646252 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.646576 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.646881 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.647213 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.647540 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.647853 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.648161 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.648467 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.648775 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.649089 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.649416 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.649737 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.650040 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.650361 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.650675 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.650996 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.651310 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.651659 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.651987 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.652294 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.652604 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.652913 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.653221 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.653538 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.653850 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.654700 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.655021 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.655383 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.655692 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.656053 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.656362 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.656707 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.657030 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:05:40.657256 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 16:05:40.693915 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_db.sqlalchemy.engines [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:40.924020 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.context [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ff700c-997f-477c-8f3b-ea37e18991fb(cell1) {{(pid=78746) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 16:05:40.932934 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_concurrency.lockutils [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:05:40.936757 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_concurrency.lockutils [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=78746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:05:40.938350 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_concurrency.lockutils [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:05:40.942452 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_concurrency.lockutils [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=78746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:05:40.953890 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.context [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ff700c-997f-477c-8f3b-ea37e18991fb(cell1) {{(pid=78745) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 16:05:40.958364 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:05:40.960170 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:05:40.961034 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:05:40.963185 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:05:40.987420 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:40.990113 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:41.005942 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_db.sqlalchemy.engines [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:41.024102 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_db.sqlalchemy.engines [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:41.036096 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:41.059673 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_db.sqlalchemy.engines [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:05:41.222535 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO keyring.backend [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Loading KWallet Sep 08 16:05:41.232830 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO keyring.backend [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Loading SecretService Sep 08 16:05:41.236411 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:05:41.236411 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: from cryptography.utils import int_from_bytes Sep 08 16:05:41.236714 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:05:41.236714 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: from cryptography.utils import int_from_bytes Sep 08 16:05:41.237468 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO keyring.backend [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Loading Windows Sep 08 16:05:41.239324 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO keyring.backend [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Loading chainer Sep 08 16:05:41.240131 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO keyring.backend [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Loading macOS Sep 08 16:05:41.243529 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO keyring.backend [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Loading KWallet Sep 08 16:05:41.255576 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO keyring.backend [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Loading SecretService Sep 08 16:05:41.259416 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:05:41.259416 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: from cryptography.utils import int_from_bytes Sep 08 16:05:41.259952 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:05:41.259952 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: from cryptography.utils import int_from_bytes Sep 08 16:05:41.261009 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO keyring.backend [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Loading Windows Sep 08 16:05:41.263142 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO keyring.backend [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Loading chainer Sep 08 16:05:41.264896 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO keyring.backend [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Loading macOS Sep 08 16:05:41.595454 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: WARNING keystonemiddleware.auth_token [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:05:41.602540 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: WARNING keystonemiddleware.auth_token [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:05:41.625680 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: WARNING keystonemiddleware.auth_token [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:05:41.632743 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: WARNING keystonemiddleware.auth_token [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:05:41.820560 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: WARNING keystonemiddleware.auth_token [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:05:41.825830 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: WARNING keystonemiddleware.auth_token [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:05:41.831437 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be6a3fb9c0 pid: 78746 (default app) Sep 08 16:05:41.833673 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:05:41.834784 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001801 Sep 08 16:05:41.835197 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 789 bytes} [Wed Sep 8 16:05:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:05:41.863695 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: WARNING keystonemiddleware.auth_token [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:05:41.868989 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: WARNING keystonemiddleware.auth_token [None req-6a4d3419-79ed-4514-a481-fc56d19fff29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:05:41.875795 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be6a3fb9c0 pid: 78745 (default app) Sep 08 16:07:14.530674 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:14.531675 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 08 16:07:14.532070 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:15.118199 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-3cd416c9-1b86-4f90-b385-ec85f1fc26c7 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:15.147219 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-3cd416c9-1b86-4f90-b385-ec85f1fc26c7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.607728 Sep 08 16:07:15.147825 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Sep 8 16:07:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:07:17.366966 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:17.367992 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-7b7994e8-bdb0-4380-af58-8126139145f9 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 08 16:07:17.368419 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:17.433121 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-dfb52532-b22e-443a-904f-a3e34e208044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "id": "c1"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:17.471499 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:07:17.471499 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: warnings.warn(msg) Sep 08 16:07:17.520414 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-dfb52532-b22e-443a-904f-a3e34e208044 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.144551 Sep 08 16:07:17.521425 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:07:17.745812 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-ed5ce7d9-74e5-4fd1-ad78-080c797e025a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:17.748811 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:07:17.748811 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: warnings.warn(msg) Sep 08 16:07:17.911060 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-ed5ce7d9-74e5-4fd1-ad78-080c797e025a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.381019 Sep 08 16:07:17.911820 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Sep 8 16:07:17 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:07:20.198677 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-dfb52532-b22e-443a-904f-a3e34e208044 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:20.200218 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-dfb52532-b22e-443a-904f-a3e34e208044 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 08 16:07:20.200796 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:07:20.321884 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-55e32032-3138-499e-b1cd-e7f28361f9e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:20.356290 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:07:20.356290 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: warnings.warn(msg) Sep 08 16:07:20.401975 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-55e32032-3138-499e-b1cd-e7f28361f9e2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.193298 Sep 08 16:07:20.403419 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:07:20.415591 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-ad38acbe-09f7-46be-a7ff-43347360e7b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:20.417162 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:07:20.417162 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: warnings.warn(msg) Sep 08 16:07:20.463624 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-ad38acbe-09f7-46be-a7ff-43347360e7b2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051661 Sep 08 16:07:20.464134 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Sep 8 16:07:20 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:07:22.694545 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-55e32032-3138-499e-b1cd-e7f28361f9e2 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:22.695583 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-55e32032-3138-499e-b1cd-e7f28361f9e2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 08 16:07:22.696023 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:22.762434 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-ac91482d-7c47-41b8-a2cc-d127ec1f35d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:22.788954 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-ac91482d-7c47-41b8-a2cc-d127ec1f35d5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085233 Sep 08 16:07:22.789511 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:07:22.806097 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-323863f0-7a2c-4f07-9ce2-e91376458a2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:22.864709 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-323863f0-7a2c-4f07-9ce2-e91376458a2b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.065591 Sep 08 16:07:22.865803 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Sep 8 16:07:22 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:07:25.163052 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-ac91482d-7c47-41b8-a2cc-d127ec1f35d5 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:25.164144 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-ac91482d-7c47-41b8-a2cc-d127ec1f35d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 08 16:07:25.164571 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:07:25.266267 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-729b88e3-f1e9-4326-9bf1-95a06403629d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:25.292665 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-729b88e3-f1e9-4326-9bf1-95a06403629d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.120906 Sep 08 16:07:25.294010 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:07:25.306088 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-383ca0ba-7341-43b8-a07e-742c0253f0ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:25.346346 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-383ca0ba-7341-43b8-a07e-742c0253f0ad admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043832 Sep 08 16:07:25.346906 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Sep 8 16:07:25 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:07:27.682014 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-729b88e3-f1e9-4326-9bf1-95a06403629d admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:27.683008 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-729b88e3-f1e9-4326-9bf1-95a06403629d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 08 16:07:27.683412 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:27.749034 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-6eba7885-fa17-4763-b727-fd1366d6c833 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:27.775391 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-6eba7885-fa17-4763-b727-fd1366d6c833 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084622 Sep 08 16:07:27.775983 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:07:27.788774 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-c379aaaf-f917-456f-8c32-47c7f2fefba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:27.829479 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-c379aaaf-f917-456f-8c32-47c7f2fefba8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044379 Sep 08 16:07:27.830443 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Sep 8 16:07:27 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:07:30.076253 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-6eba7885-fa17-4763-b727-fd1366d6c833 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:30.077520 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-6eba7885-fa17-4763-b727-fd1366d6c833 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Sep 08 16:07:30.077999 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:30 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:07:30.145323 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-bcb385c5-c124-4915-bad8-620945c17686 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:30.186417 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-bcb385c5-c124-4915-bad8-620945c17686 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.100894 Sep 08 16:07:30.187282 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Sep 8 16:07:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:07:32.477775 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-6eba7885-fa17-4763-b727-fd1366d6c833 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:32.478784 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-6eba7885-fa17-4763-b727-fd1366d6c833 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 08 16:07:32.479192 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:32.547026 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-e7637d2d-e806-4018-aecb-a1d780b34694 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:32.593181 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-e7637d2d-e806-4018-aecb-a1d780b34694 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.106282 Sep 08 16:07:32.594212 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:32 2021] POST /compute/v2.1/flavors => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:07:32.607040 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-fefa0fd2-4166-4d8a-b1e0-51b7ea877306 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:32.647894 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-fefa0fd2-4166-4d8a-b1e0-51b7ea877306 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044846 Sep 08 16:07:32.648506 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Sep 8 16:07:32 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:07:34.954234 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-e7637d2d-e806-4018-aecb-a1d780b34694 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:34.955263 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-e7637d2d-e806-4018-aecb-a1d780b34694 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 08 16:07:34.955713 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:35.021668 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-46356118-913d-4372-82f5-8c5de4c394e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "swap": 0}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:35.049217 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-46356118-913d-4372-82f5-8c5de4c394e3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086358 Sep 08 16:07:35.050302 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:34 2021] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:07:35.072302 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-020ae093-8eac-481e-8fdf-7c4501096938 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:35.118293 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-020ae093-8eac-481e-8fdf-7c4501096938 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050886 Sep 08 16:07:35.119151 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Sep 8 16:07:35 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:07:37.542117 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-46356118-913d-4372-82f5-8c5de4c394e3 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:37.543950 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-46356118-913d-4372-82f5-8c5de4c394e3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002393 Sep 08 16:07:37.544727 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:37 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:37.630213 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-ec96c79d-55e2-415a-a499-4161ba68cc75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "disk": 40}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:37.658140 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-ec96c79d-55e2-415a-a499-4161ba68cc75 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.102963 Sep 08 16:07:37.658720 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:37 2021] POST /compute/v2.1/flavors => generated 406 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:07:37.670875 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-2ef8638f-f5dc-40c6-bb4e-484a2864830c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:37.713777 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-2ef8638f-f5dc-40c6-bb4e-484a2864830c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046790 Sep 08 16:07:37.714428 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Sep 8 16:07:37 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:07:40.226186 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-ec96c79d-55e2-415a-a499-4161ba68cc75 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:40.227208 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-ec96c79d-55e2-415a-a499-4161ba68cc75 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 08 16:07:40.227662 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:07:40.307930 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-a3cff6b5-bbf3-47cc-8d50-d7783bf460bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "swap": 0, "ram": 8192}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:40.335980 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-a3cff6b5-bbf3-47cc-8d50-d7783bf460bd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.097000 Sep 08 16:07:40.336745 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:40 2021] POST /compute/v2.1/flavors => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:07:40.353415 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-d0e9fe6a-6142-452d-bd48-84dc857291dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:40.399402 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-d0e9fe6a-6142-452d-bd48-84dc857291dd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049696 Sep 08 16:07:40.400050 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Sep 8 16:07:40 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:07:42.679008 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-a3cff6b5-bbf3-47cc-8d50-d7783bf460bd admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:42.680196 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-a3cff6b5-bbf3-47cc-8d50-d7783bf460bd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Sep 08 16:07:42.680663 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:07:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:42.748265 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-e70e33af-6ef1-449d-b3ef-d458b678271b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:42.778782 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-e70e33af-6ef1-449d-b3ef-d458b678271b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089641 Sep 08 16:07:42.779672 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Sep 8 16:07:42 2021] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:07:42.792044 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-30a2d67b-a74b-4196-8027-60726b441c65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:42.830600 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-30a2d67b-a74b-4196-8027-60726b441c65 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042362 Sep 08 16:07:42.831195 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Sep 8 16:07:42 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:57.955197 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-e70e33af-6ef1-449d-b3ef-d458b678271b admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:57.956875 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-e70e33af-6ef1-449d-b3ef-d458b678271b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Sep 08 16:08:57.957922 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Wed Sep 8 16:08:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:58.025856 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-e6edaea0-fa85-418f-a117-c3647baa5dfd admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:58.051266 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-e6edaea0-fa85-418f-a117-c3647baa5dfd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.085259 Sep 08 16:08:58.051887 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Sep 8 16:08:57 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:59.550258 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-e70e33af-6ef1-449d-b3ef-d458b678271b admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:59.551261 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-e70e33af-6ef1-449d-b3ef-d458b678271b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 08 16:08:59.551712 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:08:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:08:59.757621 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-46ef8545-8ca8-4945-8162-4738d7442498 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:59.771920 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.wsgi [None req-46ef8545-8ca8-4945-8162-4738d7442498 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 16:08:59.772512 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-46ef8545-8ca8-4945-8162-4738d7442498 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:08:59.773322 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-46ef8545-8ca8-4945-8162-4738d7442498 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.075068 Sep 08 16:08:59.773880 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Sep 8 16:08:59 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:08:59.784746 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-c3da8c08-e145-428e-90ef-0e107c0db3f4 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:59.821805 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-c3da8c08-e145-428e-90ef-0e107c0db3f4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.040191 Sep 08 16:08:59.823385 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Sep 8 16:08:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:59.833886 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-8ddc56b7-f13b-4c22-8585-464de00deede admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:59.856759 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-8ddc56b7-f13b-4c22-8585-464de00deede admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026414 Sep 08 16:08:59.857335 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Sep 8 16:08:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:59.867952 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-6ba3b07d-ed22-4bdd-a16c-2bdcb4a4c490 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:59.882426 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.wsgi [None req-6ba3b07d-ed22-4bdd-a16c-2bdcb4a4c490 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 16:08:59.883024 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-6ba3b07d-ed22-4bdd-a16c-2bdcb4a4c490 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:08:59.883887 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-6ba3b07d-ed22-4bdd-a16c-2bdcb4a4c490 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019828 Sep 08 16:08:59.885222 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Sep 8 16:08:59 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:01.362288 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-8ddc56b7-f13b-4c22-8585-464de00deede admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:01.363778 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-8ddc56b7-f13b-4c22-8585-464de00deede admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Sep 08 16:09:01.364348 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:09:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:01.591049 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-f83e8af1-8fc7-4c67-91a1-8e98c587df35 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:01.604482 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.wsgi [None req-f83e8af1-8fc7-4c67-91a1-8e98c587df35 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 16:09:01.605078 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-f83e8af1-8fc7-4c67-91a1-8e98c587df35 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:09:01.605923 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-f83e8af1-8fc7-4c67-91a1-8e98c587df35 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.099235 Sep 08 16:09:01.606483 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Sep 8 16:09:01 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 08 16:09:01.616842 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-a26e34d8-80c9-4324-9145-40dd9f7a85fd admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:01.639065 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-a26e34d8-80c9-4324-9145-40dd9f7a85fd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026091 Sep 08 16:09:01.639673 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Sep 8 16:09:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:09:01.649930 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-c74c3613-dafb-49e8-9a33-3ddce718be27 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:01.672659 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-c74c3613-dafb-49e8-9a33-3ddce718be27 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026094 Sep 08 16:09:01.673308 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Sep 8 16:09:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:09:01.684554 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-e3218f8b-4f4f-4d33-a6d6-9a5e56445ecc admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:01.698890 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.wsgi [None req-e3218f8b-4f4f-4d33-a6d6-9a5e56445ecc admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 16:09:01.699518 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-e3218f8b-4f4f-4d33-a6d6-9a5e56445ecc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:09:01.700347 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-e3218f8b-4f4f-4d33-a6d6-9a5e56445ecc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.020296 Sep 08 16:09:01.700913 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Sep 8 16:09:01 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:03.083536 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-c74c3613-dafb-49e8-9a33-3ddce718be27 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:03.084553 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-c74c3613-dafb-49e8-9a33-3ddce718be27 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 08 16:09:03.084963 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:09:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:09:03.350013 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-5033eadd-9008-453b-93e1-1dcb24883762 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:03.364541 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.wsgi [None req-5033eadd-9008-453b-93e1-1dcb24883762 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 16:09:03.365272 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-5033eadd-9008-453b-93e1-1dcb24883762 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:09:03.366212 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-5033eadd-9008-453b-93e1-1dcb24883762 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.070584 Sep 08 16:09:03.366893 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Sep 8 16:09:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:03.381474 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-58d1e010-6d21-4128-adcf-ac38401a81f2 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:03.425932 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-58d1e010-6d21-4128-adcf-ac38401a81f2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.050989 Sep 08 16:09:03.426987 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Sep 8 16:09:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:09:03.441684 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:03.464850 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027022 Sep 08 16:09:03.465434 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Sep 8 16:09:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:09:03.475291 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-b1db9cba-c5bd-45d2-a3c3-9f5e98108b8a admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:03.488496 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.wsgi [None req-b1db9cba-c5bd-45d2-a3c3-9f5e98108b8a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 16:09:03.489075 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-b1db9cba-c5bd-45d2-a3c3-9f5e98108b8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:09:03.489878 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-b1db9cba-c5bd-45d2-a3c3-9f5e98108b8a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018308 Sep 08 16:09:03.490432 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Sep 8 16:09:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:09:04.885702 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:04.886963 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Sep 08 16:09:04.887374 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:09:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:05.093062 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-21288e42-33fc-4322-8360-8399b93c5469 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:05.121696 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-21288e42-33fc-4322-8360-8399b93c5469 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.087228 Sep 08 16:09:05.122252 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Sep 8 16:09:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:09:06.586237 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:06.588418 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Sep 08 16:09:06.589061 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:09:06 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:06.798443 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-61eabe4c-9645-4236-b8b6-3a15665b6df3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:06.829242 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-61eabe4c-9645-4236-b8b6-3a15665b6df3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.093676 Sep 08 16:09:06.829791 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Sep 8 16:09:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:09:08.304607 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:08.305662 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 08 16:09:08.306112 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:09:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:09:08.514502 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-34a94ef1-66a6-4089-9e43-29c0d225430c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:08.554609 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-34a94ef1-66a6-4089-9e43-29c0d225430c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.096437 Sep 08 16:09:08.555669 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Sep 8 16:09:08 2021] POST /compute/v2.1/flavors => generated 407 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:09:10.280185 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:10.281626 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002842 Sep 08 16:09:10.282604 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:09:10 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:10.585031 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-de4f81c0-ab0f-4243-acbd-e380de2b3221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:10.623839 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-de4f81c0-ab0f-4243-acbd-e380de2b3221 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.118594 Sep 08 16:09:10.626467 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Sep 8 16:09:10 2021] POST /compute/v2.1/flavors => generated 409 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:09:12.130691 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:12.131889 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Sep 08 16:09:12.132306 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:09:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:12.339541 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-ddf27f72-2403-440d-880e-8fd66db3cfb7 admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:12.372277 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-ddf27f72-2403-440d-880e-8fd66db3cfb7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.097356 Sep 08 16:09:12.372896 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1203 bytes} [Wed Sep 8 16:09:12 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:00.459509 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:00.460512 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55eef8ed-73a7-4959-b3cf-432c95d08fe2 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 08 16:10:00.461103 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 31/63] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:10:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:00.698228 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:00.729827 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.086979 Sep 08 16:10:00.730591 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1203 bytes} [Wed Sep 8 16:10:00 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:11:35.285826 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-99ebc358-59de-4689-bec8-c2ac99e0b118 tempest-verify_tempest_config-1961882034 tempest-verify_tempest_config-1961882034-project] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:35.288213 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-99ebc358-59de-4689-bec8-c2ac99e0b118 tempest-verify_tempest_config-1961882034 tempest-verify_tempest_config-1961882034-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.125018 Sep 08 16:11:35.288782 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Sep 8 16:11:35 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:13:11.404409 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:11.406168 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002624 Sep 08 16:13:11.406769 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 34/66] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:13:11 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:11.874470 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-9eb10986-f07a-4a86-adb1-5048fd850b41 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:11.876102 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:13:11.876102 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: warnings.warn(msg) Sep 08 16:13:11.878541 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-9eb10986-f07a-4a86-adb1-5048fd850b41 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:11.879220 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-9eb10986-f07a-4a86-adb1-5048fd850b41 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:11.880190 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-9eb10986-f07a-4a86-adb1-5048fd850b41 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:11.880733 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-9eb10986-f07a-4a86-adb1-5048fd850b41 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:11.916197 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-9eb10986-f07a-4a86-adb1-5048fd850b41 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.243490 Sep 08 16:13:11.916789 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Sep 8 16:13:11 2021] GET /compute/v2.1/os-services => generated 791 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:13:13.543202 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:13.544765 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Sep 08 16:13:13.545242 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 35/68] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:13:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:13:13.786163 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-27d84cec-f821-4a13-8dfe-4dca10a3ff20 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:13.788309 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:13:13.788309 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: warnings.warn(msg) Sep 08 16:13:13.791107 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-27d84cec-f821-4a13-8dfe-4dca10a3ff20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:13.791581 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-27d84cec-f821-4a13-8dfe-4dca10a3ff20 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:13.792681 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-27d84cec-f821-4a13-8dfe-4dca10a3ff20 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:13.793388 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-27d84cec-f821-4a13-8dfe-4dca10a3ff20 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:13.825343 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-27d84cec-f821-4a13-8dfe-4dca10a3ff20 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.103237 Sep 08 16:13:13.825958 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 34/69] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Sep 8 16:13:13 2021] GET /compute/v2.1/os-services => generated 791 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:13:25.843416 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:25.844968 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Sep 08 16:13:25.845993 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:13:25 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:26.039158 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-5fd2c354-6de6-44a0-a5b2-c4149d0790f6 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:26.040342 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:13:26.040342 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: warnings.warn(msg) Sep 08 16:13:26.041876 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-5fd2c354-6de6-44a0-a5b2-c4149d0790f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:26.042360 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-5fd2c354-6de6-44a0-a5b2-c4149d0790f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:26.043132 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-5fd2c354-6de6-44a0-a5b2-c4149d0790f6 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:26.043580 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-5fd2c354-6de6-44a0-a5b2-c4149d0790f6 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:26.073813 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-5fd2c354-6de6-44a0-a5b2-c4149d0790f6 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.088560 Sep 08 16:13:26.074295 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 35/71] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Sep 8 16:13:25 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:27.523955 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: DEBUG nova.api.openstack.wsgi [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] Calling method '>' {{(pid=78746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:27.525117 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: INFO nova.api.openstack.requestlog [None req-f19f54aa-9605-4998-8357-ccd24bb9120b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001785 Sep 08 16:13:27.525569 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: [pid: 78746|app: 0|req: 37/72] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Sep 8 16:13:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:13:27.744226 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG nova.api.openstack.wsgi [None req-55070764-56f9-42b3-b80f-4219a1df4bc9 admin admin] Calling method '>' {{(pid=78745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:27.746321 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:13:27.746321 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: warnings.warn(msg) Sep 08 16:13:27.748886 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-55070764-56f9-42b3-b80f-4219a1df4bc9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:27.749523 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-55070764-56f9-42b3-b80f-4219a1df4bc9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:27.751056 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-55070764-56f9-42b3-b80f-4219a1df4bc9 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:13:27.751860 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: DEBUG oslo_concurrency.lockutils [None req-55070764-56f9-42b3-b80f-4219a1df4bc9 admin admin] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:13:27.799501 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: INFO nova.api.openstack.requestlog [None req-55070764-56f9-42b3-b80f-4219a1df4bc9 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.119368 Sep 08 16:13:27.800544 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: [pid: 78745|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Sep 8 16:13:27 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:14:26.739909 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: Wed Sep 8 16:14:26 2021 - graceful shutdown triggered... Sep 08 16:14:26.740214 dv-cinder-807898-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 16:14:26.741203 dv-cinder-807898-1-iscsi devstack@n-api.service[78745]: Gracefully killing worker 1 (pid: 78745)... Sep 08 16:14:26.741579 dv-cinder-807898-1-iscsi devstack@n-api.service[78746]: Gracefully killing worker 2 (pid: 78746)... Sep 08 16:14:27.742042 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: worker 1 buried after 1 seconds Sep 08 16:14:27.742042 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: worker 2 buried after 1 seconds Sep 08 16:14:27.742042 dv-cinder-807898-1-iscsi devstack@n-api.service[78744]: goodbye to uWSGI. Sep 08 16:14:27.743775 dv-cinder-807898-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 08 16:14:27.744585 dv-cinder-807898-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 16:14:27.747913 dv-cinder-807898-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 16:14:27.761696 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 8 16:14:27 2021] *** Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: nodename: dv-cinder-807898-1-iscsi Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: machine: x86_64 Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: clock source: unix Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: pcre jit disabled Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: detected number of CPU cores: 4 Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: current working directory: / Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: detected binary path: /usr/bin/uwsgi-core Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: your processes number limit is 47680 Sep 08 16:14:27.765716 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: your memory page size is 4096 bytes Sep 08 16:14:27.767324 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: detected max file descriptor number: 2048 Sep 08 16:14:27.767324 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: lock engine: pthread robust mutexes Sep 08 16:14:27.767324 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: thunder lock: enabled Sep 08 16:14:27.767324 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 16:14:27.767324 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 08 16:14:27.810809 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: Python main interpreter initialized at 0x55796ef019c0 Sep 08 16:14:27.810809 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: python threads support enabled Sep 08 16:14:27.810809 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: your server socket listen backlog is limited to 100 connections Sep 08 16:14:27.810809 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: your mercy for graceful operations on workers is 90 seconds Sep 08 16:14:27.812667 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 16:14:27.812667 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: *** Operational MODE: preforking *** Sep 08 16:14:27.812667 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: *** uWSGI is running in multiple interpreter mode *** Sep 08 16:14:27.812667 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: spawned uWSGI master process (pid: 93598) Sep 08 16:14:27.812667 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: spawned uWSGI worker 1 (pid: 93617, cores: 1) Sep 08 16:14:27.812516 dv-cinder-807898-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 16:14:27.813277 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: spawned uWSGI worker 2 (pid: 93618, cores: 1) Sep 08 16:14:27.813277 dv-cinder-807898-1-iscsi devstack@n-api.service[93598]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 16:14:32.214665 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 16:14:32.215718 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 16:14:32.215718 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 16:14:32.215925 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 16:14:32.216064 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 16:14:32.216463 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.216781 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.217112 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.217971 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.218311 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.218634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.218972 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.219304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.219719 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.219974 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.220300 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.220632 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807898-1-iscsi {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.220960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.221276 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.221597 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.221922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.222234 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.222565 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.222877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.223393 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.225138 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.225138 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.225138 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.225584 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.225584 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.225863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.226278 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.226465 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.226790 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.227114 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.227556 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807898-1-iscsi {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.227953 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.228349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.228349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.229144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.229144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.229907 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.229907 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.230648 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.230648 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.231201 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.231201 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.231881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.231881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.232297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.232297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.232685 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.233704 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.233974 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.234209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.234442 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.234600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.234912 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.235317 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.235607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.235853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.236102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.237136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.237136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.237479 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.237728 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.237942 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.238265 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.238514 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.238792 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.239159 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.239419 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.239824 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.240078 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.240410 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.240724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.241051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.241462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.241711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.242019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.242370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.242692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.243003 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.243539 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.243736 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.244001 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.244280 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.244593 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.244950 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.245596 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.245596 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.245998 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.246194 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.246376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.246699 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.247305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.247305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.247815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.248048 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.248273 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.248622 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.248907 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.249301 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.249531 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.249842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.250155 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.250474 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.250849 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.251096 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.251422 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.251757 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.252070 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.252378 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.252690 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.253018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.253327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.253946 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.253946 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.254387 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.254635 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.254872 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.255147 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.255758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.256017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.256261 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.256489 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.256727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.257006 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.257711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.257711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.258208 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.258208 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.258714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.259102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.259102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.259798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.259798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.260270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.260516 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.260744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.261013 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.261432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.261692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.261922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.262224 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.262547 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.262891 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.263229 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.263580 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.263881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.264978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.265224 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.265477 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.265734 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.266458 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.266458 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.266911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.266911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.268801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.268801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.268801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.268801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.268801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.268801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.270552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.270552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.270552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.270552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.270552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272989 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272989 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.272989 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.273665 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.273665 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.274095 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.274532 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.274532 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.274988 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.275374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.275374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.275883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.276123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.276657 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.276657 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.277106 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.277333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.277566 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.277865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.278180 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.278903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.278903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.279360 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.279649 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.279972 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.280727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.280727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.280727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.281369 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.281592 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.281865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.282298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.282577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.283100 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.283346 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.283703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.283938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.284309 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.284771 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.285010 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.285255 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.285684 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.285898 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.286190 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.286766 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.287003 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.287248 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.287541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.287781 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.288032 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.288344 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.288806 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.289354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.289354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.289825 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.290052 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.290275 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.290565 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.291911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.291911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.291911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.291911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.293034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.293034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.293034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.293034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.294025 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.294025 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.294025 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.294662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.294662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.295330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.295330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.296540 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.296540 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.297303 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.297303 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.297750 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.297981 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.298203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.298441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.298754 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.299185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.299780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.299780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.300257 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.300498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.300723 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.300989 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.301361 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.301586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.301805 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.302230 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.302492 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.302935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.303182 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.303418 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.303707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.303981 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.304316 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.304636 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.304947 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.305456 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.305693 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.305913 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.306382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.306646 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.306916 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.307444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.307444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.307970 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.308211 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.308449 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.308725 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.309052 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.309443 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.310033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.310033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.310495 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.310735 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.310974 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.311308 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.311765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.312002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.312267 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.312689 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.312956 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.313484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.313827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.314155 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.314485 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.314816 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.315145 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.315744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.316132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.316132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.316761 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.316761 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.317193 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.317713 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.317713 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.318156 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.318381 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.318605 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.318878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.319192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.319621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.319837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.320278 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.320447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.320736 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.321054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.321373 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.321820 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.322060 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.322303 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.322613 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.322991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.323260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.323727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.323981 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.324258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.324604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.324927 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.325238 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.325573 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.326017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.326270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.326474 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.327447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.328044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.328044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.328498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.328782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.329095 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.329412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.329834 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.330073 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.330615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.330615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.331102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.331349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.331631 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.331888 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.332264 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.332533 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.332771 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.333226 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.333479 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.333729 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.334136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.334374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.334611 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.334891 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.335209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.335541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.335857 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.336302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.336974 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.336974 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.337455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.337455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.338555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.338555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.338555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.338555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.339435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.339435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.339435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.340279 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.340279 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.341379 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.341379 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.341379 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.341379 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.342520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.342520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.342520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.343220 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.343220 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.343953 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.343953 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.344598 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.344598 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.345054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.345054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.345617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.345617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.346069 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.346312 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.346312 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.347216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.347216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.347709 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.348420 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.348420 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.348420 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.349097 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.349097 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.349519 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.349744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.350033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.350294 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.350673 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.350925 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.351529 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.351529 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.351991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.352207 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.352497 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.352883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.353118 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.353365 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.353980 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.353980 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.354490 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.354753 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.355186 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.355432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.355735 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.356005 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.356302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.356616 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.357068 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.357317 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.357567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.357826 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.359043 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.359043 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.359621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.359865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.360125 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.360390 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.360657 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.361033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.361325 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.362135 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.362374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.362626 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.362888 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.363277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.363600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.364403 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.364403 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.364885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.364885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.365546 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.365546 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.366046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.366311 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.366549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.366735 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.367191 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.367459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.368167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.368167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.368589 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.369187 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.369187 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.369525 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.369687 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.370009 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.370317 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.370638 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.371074 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.371262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.371634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.372117 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.372372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.372607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.372838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.373153 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.373607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.373891 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.374201 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.374893 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.374893 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.375364 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.376146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.376146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.376146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.376853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.376853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.377327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.377327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.378008 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.378008 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.378489 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.378731 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.379453 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.379453 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.379995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.379995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.380711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.380711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.381235 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.381235 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.381835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.381835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.382664 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.382664 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.382664 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.383363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.383363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.384294 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.384294 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.384294 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.385304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.385304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.385304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.386203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.386203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.386203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.386942 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.386942 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.386942 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.387711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.387711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.388662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.388662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.388662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.390961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.390961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.390961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.390961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.390961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.390961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.392909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.392909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.392909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.392909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.392909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.394223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.394223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.394223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.394223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.395160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.395160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.395160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.396115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.396115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.396115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.396115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.397250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.397250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.397250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.397918 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.397918 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.398613 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.398613 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.399114 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.399114 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.399621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.399903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.400518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.400518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.401995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.401995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.401995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.401995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.401995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.403567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.403567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.403567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.403567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.403567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.409504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.412575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.414431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.420209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.422931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.424845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.426779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.428767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.430564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.435119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.437808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.439765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.444090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.446021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.447935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.450258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.452900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.453885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.454838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.454838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.454838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.454838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.454838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.454838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.454838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.455711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.455711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.455960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.456097 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.456724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.456724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.457076 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.457544 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.457813 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.458087 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.458354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.458673 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.458924 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.459245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.459600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.459928 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.460265 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.460610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.460948 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.461288 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.461769 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.462039 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.462286 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.462725 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.462991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 16:14:32.504038 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_db.sqlalchemy.engines [None req-26c2437b-794e-423d-824c-002287910c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:32.707457 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 16:14:32.708372 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 16:14:32.708372 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 16:14:32.708632 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 16:14:32.708942 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 16:14:32.709256 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.709555 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.709888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.710215 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.710553 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.710896 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.711201 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.711549 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.711889 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.712155 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.712477 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.712811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-807898-1-iscsi {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.713141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.713454 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.713771 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.714095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.714406 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.714737 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.715052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.715599 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.715925 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.716237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.716554 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.716903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.717225 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.718098 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.718427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.718747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.719282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.719624 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.719957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-807898-1-iscsi {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.720287 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.720605 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.720931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.721365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.721683 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.722001 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.722330 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.722662 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.722983 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.724924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.724924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.724924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.724924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.724924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.724924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.726431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.726431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.726431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.726431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.726431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.727603 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.727603 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.727603 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.728320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.728320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.728320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.729064 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.729064 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.729548 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.729548 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.730052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.730303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.730561 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.730809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.731097 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.731377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.731654 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.731923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.732254 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.732568 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.732897 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.734071 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.734328 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.735093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.735093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.735665 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.735665 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.736174 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.736437 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.736696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.737196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.737480 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.737748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.738031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.738352 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.738607 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.738918 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.739225 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.739580 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.739898 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.740210 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.740523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.740830 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.741143 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.741456 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.741770 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.742079 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.742414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.742705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.743017 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.743328 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.743664 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.744024 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.744342 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.744654 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.744966 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.745280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.745592 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.745920 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.746237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.746548 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.746880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.747214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.747514 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.747845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.748168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.748478 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.749036 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.749359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.749675 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.750137 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.750314 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.750612 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.750921 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.751230 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.751564 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.751997 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.752193 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.752476 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.752783 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.753114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.753442 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.753758 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.754234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.754456 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.754958 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:14:32.755156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.755361 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.755718 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.756045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.756385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.759542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.760640 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.760640 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.760640 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.760640 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.760640 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.761366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.761366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.761366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.761721 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.762025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.762343 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.762689 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.763041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.763364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.763722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.764045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.765009 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.765009 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.765498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.765498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.765973 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.766217 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.766498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.766745 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.767015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.767445 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.768256 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.768584 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.768901 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.769225 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.769540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.769870 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.770213 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.770526 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.770872 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.771192 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.771565 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.771856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.772173 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.772491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.772809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.773125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.773460 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.773776 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.774093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.774423 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.774736 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.775047 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.775369 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.775715 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.776036 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.776483 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.776753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.777003 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.777285 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.777742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.778021 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.778386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.778638 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.778896 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.779218 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.779554 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.780542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.780972 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.781397 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.781720 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.782045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.782366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.782824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.783120 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.783366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.783674 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.783935 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.784261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.784663 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.785276 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.785599 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.785947 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.context [None req-26c2437b-794e-423d-824c-002287910c04 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ff700c-997f-477c-8f3b-ea37e18991fb(cell1) {{(pid=93617) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 16:14:32.786207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.786481 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.786905 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.786905 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.787397 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.787721 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.788190 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.788190 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.788705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.788950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.789192 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.789430 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.789780 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.790042 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.790282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.790616 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.790957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.791206 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-26c2437b-794e-423d-824c-002287910c04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:14:32.791506 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.791815 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.792164 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.792491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.792740 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-26c2437b-794e-423d-824c-002287910c04 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:14:32.792992 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.793249 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.793494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.793750 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-26c2437b-794e-423d-824c-002287910c04 None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:14:32.794007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.794007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.794471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.794734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.794979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.795260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.796218 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.796550 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.797312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.797577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-26c2437b-794e-423d-824c-002287910c04 None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:14:32.797845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.797845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.797845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.798749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.798749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.798749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.799428 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.799428 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.800103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.800103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.800582 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.800582 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.801035 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.801291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.801540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.801844 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.802168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.802500 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.802871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.803116 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.803429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.803788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.804124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.804450 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.804768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.805089 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.805459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.805697 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.806015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.806496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.806750 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.807018 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.807286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.807775 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.808018 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.808271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.808798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.809144 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.809469 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.812666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.815065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.817583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.819904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.821788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.821788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.821788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.821788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.821788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.821788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.823627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.823627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.823627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.823627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.823627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.823627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825033 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825033 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825033 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825033 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825974 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825974 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825974 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.825974 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.827165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.827165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.827797 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_db.sqlalchemy.engines [None req-26c2437b-794e-423d-824c-002287910c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:32.828214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.828214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.828214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.828214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.829185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.829185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.829185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.830085 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.830085 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.830085 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.830774 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.830774 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.831261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.831261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.831880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.831880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.832354 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.832354 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.832839 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.833079 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.833334 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.833577 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.833834 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.834136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.834445 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.834803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.835117 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.835519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.836061 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.836311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.836775 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.836775 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.839247 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.841926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.852002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.854107 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.854357 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_db.sqlalchemy.engines [None req-26c2437b-794e-423d-824c-002287910c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.855291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.857431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.860139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.862399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.863811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.863811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.863811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.863811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.863811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.863811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.863811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.866678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.866678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.866678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.868580 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.869041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.869682 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.870326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.871292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.872773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.872773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.873267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.873916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.874553 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.875126 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.875767 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.876781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.877882 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.878747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.881095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.881095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.881095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.881417 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.881888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.882472 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.883061 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.883320 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_db.sqlalchemy.engines [None req-26c2437b-794e-423d-824c-002287910c04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:32.883865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.884375 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.884909 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.885547 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.886345 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.886878 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.887305 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.887699 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.888083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.888866 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.889793 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.890069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.890735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.891535 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.892201 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.892589 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.893188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.893645 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.894154 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.894655 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.895000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.895346 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.895728 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.896182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.896748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.897316 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.897899 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.898485 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.899516 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.899920 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.900835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.901860 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.902463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.903136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.904286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.905430 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.906043 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.906621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.907205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.907819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.908493 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.909315 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.909964 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.910574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.911310 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.912348 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.912958 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.913596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.914197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.914801 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.915408 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.916069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.916685 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.917277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.917884 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.918488 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.919302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.920034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.921204 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.922541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.923162 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.923785 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.924354 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.924931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.925522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.926124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.926682 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.927272 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.927891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.928486 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.929129 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.929983 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.930625 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.931293 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.931993 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.932816 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.933431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.934026 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.934701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.935303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.935889 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.936538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.937159 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.937760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.938582 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.939199 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.940068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.940678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.941137 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.941481 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.942035 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.942860 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.943889 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.944472 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.945069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.945792 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.946405 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.947026 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.948305 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.948880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.949505 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.950138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.950779 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.951614 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.952497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.953170 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.953753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.954386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.954993 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.955617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.956208 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.956801 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.957357 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.957916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.958513 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.959109 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.960166 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.960784 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.961370 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.961992 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.962852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.963455 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.964072 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.964690 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.965270 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.965853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.966500 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.967077 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.968193 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.968771 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.969602 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.970202 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.971009 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.971631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.972217 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.972835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.973653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.974243 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.974833 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.975435 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.976048 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.976629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.977208 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.977823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.978433 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.979010 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.979647 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.980461 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.981065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.981653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.982261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.982845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.984202 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.984779 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.985352 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.985955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.986719 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.987632 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.988241 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.988876 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.989540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.990136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.991202 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.991857 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.992466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.993103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.993730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.994321 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.994903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.995538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.996165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.996752 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.997330 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.997916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.998502 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:32.999662 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.000250 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.000839 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.001429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.002367 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.002951 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.003641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.004321 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.005227 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.005850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.006453 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.007057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.007676 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.008273 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.008867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.009473 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.010102 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.010725 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.011256 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.012030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.012599 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.013184 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.013794 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.014963 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.015646 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.016308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.016931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.017540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.018125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.018707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.019290 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.019919 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.022007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.022007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.022213 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.022749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.023373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.023998 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.024587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.025176 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.025760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.026337 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.027531 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.028148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.028755 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.029354 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.030027 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.030605 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.031549 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.032141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.032747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.033347 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.033943 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.034541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.035124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.035763 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.036368 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.036978 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.037582 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.038198 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.039042 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.039681 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.040271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.040902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.041486 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.042080 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.042671 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.043258 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.043877 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.044464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.045091 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.046308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.046805 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.047707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.048388 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.048991 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.049686 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.050276 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.050893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.051464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.052072 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.052645 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.053227 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.053824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.054409 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.055036 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.055678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.056294 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.056916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.057558 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.058142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.058787 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.059380 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:14:33.059846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 16:14:33.119624 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_db.sqlalchemy.engines [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:33.158386 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO keyring.backend [None req-26c2437b-794e-423d-824c-002287910c04 None None] Loading KWallet Sep 08 16:14:33.168187 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO keyring.backend [None req-26c2437b-794e-423d-824c-002287910c04 None None] Loading SecretService Sep 08 16:14:33.172053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:14:33.172053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: from cryptography.utils import int_from_bytes Sep 08 16:14:33.172422 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:14:33.172422 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: from cryptography.utils import int_from_bytes Sep 08 16:14:33.173257 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO keyring.backend [None req-26c2437b-794e-423d-824c-002287910c04 None None] Loading Windows Sep 08 16:14:33.175264 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO keyring.backend [None req-26c2437b-794e-423d-824c-002287910c04 None None] Loading chainer Sep 08 16:14:33.176115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO keyring.backend [None req-26c2437b-794e-423d-824c-002287910c04 None None] Loading macOS Sep 08 16:14:33.382403 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.context [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c4ff700c-997f-477c-8f3b-ea37e18991fb(cell1) {{(pid=93618) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 16:14:33.387636 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:14:33.389513 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:14:33.390483 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:14:33.392655 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:14:33.431796 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_db.sqlalchemy.engines [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:33.433100 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_db.sqlalchemy.engines [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:33.438061 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: WARNING keystonemiddleware.auth_token [None req-26c2437b-794e-423d-824c-002287910c04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:14:33.445019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: WARNING keystonemiddleware.auth_token [None req-26c2437b-794e-423d-824c-002287910c04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:14:33.472587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_db.sqlalchemy.engines [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Sep 08 16:14:33.630769 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO keyring.backend [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Loading KWallet Sep 08 16:14:33.642417 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO keyring.backend [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Loading SecretService Sep 08 16:14:33.646359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:14:33.646359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: from cryptography.utils import int_from_bytes Sep 08 16:14:33.646810 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:14:33.646810 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: from cryptography.utils import int_from_bytes Sep 08 16:14:33.647702 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO keyring.backend [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Loading Windows Sep 08 16:14:33.649711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO keyring.backend [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Loading chainer Sep 08 16:14:33.650522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO keyring.backend [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Loading macOS Sep 08 16:14:33.698689 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: WARNING keystonemiddleware.auth_token [None req-26c2437b-794e-423d-824c-002287910c04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:14:33.704426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: WARNING keystonemiddleware.auth_token [None req-26c2437b-794e-423d-824c-002287910c04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:14:33.710238 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55796ef019c0 pid: 93617 (default app) Sep 08 16:14:34.012329 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: WARNING keystonemiddleware.auth_token [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:14:34.019463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: WARNING keystonemiddleware.auth_token [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:14:34.240617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: WARNING keystonemiddleware.auth_token [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:14:34.246286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: WARNING keystonemiddleware.auth_token [None req-8f41dc91-8927-42e6-a8b6-2d1a14e127fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:14:34.251987 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55796ef019c0 pid: 93618 (default app) Sep 08 16:15:22.720263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9f803c68-a579-47fb-8dfb-23573332af66 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Action: 'create', calling method: .version_select at 0x7f370526bdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1886184280", "metadata": {"Type": "work"}}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:23.294137 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-05327e2a-d336-4db5-904b-2e0fddb8fc00 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Action: 'create', calling method: .version_select at 0x7f3705362820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1453014018"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:24.723992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9f803c68-a579-47fb-8dfb-23573332af66 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.392550 Sep 08 16:15:24.725139 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Sep 8 16:15:21 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 08 16:15:24.759300 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d9938f42-241b-42f8-ad4a-1781cca03471 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Calling method '.version_select at 0x7f37051430d0>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:24.837553 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-05327e2a-d336-4db5-904b-2e0fddb8fc00 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.491573 Sep 08 16:15:24.838773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Sep 8 16:15:21 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3494 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 16:15:24.855914 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2387227d-c114-4aa7-aaef-2f8a9db3e1ef tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37050ff040>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:24.969866 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d9938f42-241b-42f8-ad4a-1781cca03471 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e" status: 200 len: 353 microversion: 2.1 time: 0.233738 Sep 08 16:15:24.971144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:24 2021] GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e => generated 353 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:25.163017 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2387227d-c114-4aa7-aaef-2f8a9db3e1ef tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03" status: 200 len: 345 microversion: 2.1 time: 0.312778 Sep 08 16:15:25.163802 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:24 2021] GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03 => generated 345 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:25.987680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5dc77dfb-c6ac-4e2d-b61c-781b490dcfb7 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Calling method '.version_select at 0x7f3705143940>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:26.197390 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b6a31425-42b0-4b60-9311-b3150b744a09 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37050ff8b0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:26.296581 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5dc77dfb-c6ac-4e2d-b61c-781b490dcfb7 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e" status: 200 len: 353 microversion: 2.1 time: 0.313742 Sep 08 16:15:26.297613 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:25 2021] GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e => generated 353 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:26.541691 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b6a31425-42b0-4b60-9311-b3150b744a09 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03" status: 200 len: 346 microversion: 2.1 time: 0.352345 Sep 08 16:15:26.556442 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:26 2021] GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03 => generated 346 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:26.570949 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7ceefe86-576a-43f1-9d11-f3dd0365c766 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Action: 'create', calling method: .version_select at 0x7f3705143f70>, body: {"snapshot": {"volume_id": "c2efe72a-b196-438b-9b81-7fe5d2673d03", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1956017400"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:27.291673 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7ceefe86-576a-43f1-9d11-f3dd0365c766 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.733358 Sep 08 16:15:27.302271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 4/7] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Sep 8 16:15:26 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:15:27.324747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-56261657-ed25-4c15-9c8e-2baba4887404 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Calling method '.version_select at 0x7f3705143280>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:27.327439 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0b415f15-34fc-4563-a207-ab7deb132bc9 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37050ffe50>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:27.452448 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0b415f15-34fc-4563-a207-ab7deb132bc9 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65" status: 200 len: 287 microversion: 2.1 time: 0.146224 Sep 08 16:15:27.453284 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Sep 8 16:15:27 2021] GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:27.464596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-551cc258-8323-4040-8d5c-857409ba1281 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37050ff3a0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:27.547028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-551cc258-8323-4040-8d5c-857409ba1281 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.086777 Sep 08 16:15:27.548013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Sep 8 16:15:27 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:27.560207 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-56261657-ed25-4c15-9c8e-2baba4887404 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e" status: 200 len: 354 microversion: 2.1 time: 0.248577 Sep 08 16:15:27.560533 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-59ee5f37-2047-40fd-beb8-57d1c41ef894 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f3705108940>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:27.562258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 5/10] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:27 2021] GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:15:27.585395 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-439c1318-967d-4df2-96b3-efa0e6c74456 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Calling method '.version_select at 0x7f37051595e0>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:27.644119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-59ee5f37-2047-40fd-beb8-57d1c41ef894 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65" status: 200 len: 287 microversion: 2.1 time: 0.088547 Sep 08 16:15:27.644693 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Sep 8 16:15:27 2021] GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:15:27.789813 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-439c1318-967d-4df2-96b3-efa0e6c74456 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e" status: 200 len: 354 microversion: 2.1 time: 0.210974 Sep 08 16:15:27.794882 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:27 2021] GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:15:27.816240 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-251c22a8-59a7-41bd-8005-5df9f4aaeeb6 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Calling method '.version_select at 0x7f3705108f70>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:28.038781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-251c22a8-59a7-41bd-8005-5df9f4aaeeb6 tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e" status: 202 len: 0 microversion: 2.1 time: 0.228855 Sep 08 16:15:28.040729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Sep 8 16:15:27 2021] DELETE /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:15:28.050380 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1868d7a7-e585-4ec3-8bf0-4da97e073b1d tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Calling method '.version_select at 0x7f37051431f0>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:28.354765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1868d7a7-e585-4ec3-8bf0-4da97e073b1d tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e" status: 200 len: 353 microversion: 2.1 time: 0.304071 Sep 08 16:15:28.358663 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:28 2021] GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e => generated 353 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:28.421031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-75852733", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "6bd4bad4-7d18-4105-b675-5870b656863f"}]}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:28.673949 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a6fed078-6c66-4f93-91c1-2ecbc867d580 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f3705143d30>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:28.705646 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] validate_networks() for [('6bd4bad4-7d18-4105-b675-5870b656863f', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:15:28.890483 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a6fed078-6c66-4f93-91c1-2ecbc867d580 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65" status: 200 len: 287 microversion: 2.1 time: 0.235920 Sep 08 16:15:28.895901 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Sep 8 16:15:28 2021] GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65 => generated 287 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:29.347264 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1786454265", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "204b86ab-9a41-430c-b098-cab74514186e"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:29.625937 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] validate_networks() for [('204b86ab-9a41-430c-b098-cab74514186e', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:15:31.593271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:15:31.596158 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:15:31.597044 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:15:31.597702 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:15:31.598458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:15:31.615766 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:31.616461 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:31.617907 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:31.617907 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:31.651938 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Getting quotas for project bb538f430ca94bd7b35bbf827cacf743. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:15:31.659771 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Getting quotas for user 89479db82b2c458e87504bd4ea2f1676 and project bb538f430ca94bd7b35bbf827cacf743. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:15:31.677856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:15:31.684606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:15:31.814720 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:15:31.815577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:15:31.815930 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:15:31.816456 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:15:31.817044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:15:31.830193 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-de9ac8c7-e1e2-4ea8-b702-b3ce32184470 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.590046 Sep 08 16:15:31.838742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 8/16] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:15:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 3599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:15:31.844557 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:31.845161 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:31.848184 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-34a73c93-ed1c-42d2-bcba-79a7b8c7411d tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Calling method '.version_select at 0x7f370504aca0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:31.849693 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:31.850376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:31.910191 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:15:31.919839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for user 7beb1f9356b8445ebaaf7a422a8aad6b and project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:15:31.950770 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:15:31.953701 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:15:32.054051 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-34a73c93-ed1c-42d2-bcba-79a7b8c7411d tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] HTTP exception thrown: Volume 3b6bb30d-f541-4949-a1da-12ce0400af2e could not be found. Sep 08 16:15:32.054825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-34a73c93-ed1c-42d2-bcba-79a7b8c7411d tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] Returning 404 to user: Volume 3b6bb30d-f541-4949-a1da-12ce0400af2e could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:32.055775 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-34a73c93-ed1c-42d2-bcba-79a7b8c7411d tempest-VolumesGetTestJSON-484282065 tempest-VolumesGetTestJSON-484282065-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e" status: 404 len: 109 microversion: 2.1 time: 0.215546 Sep 08 16:15:32.056596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:31 2021] GET /compute/v2.1/os-volumes/3b6bb30d-f541-4949-a1da-12ce0400af2e => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:32.066068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b408e0d3-3647-4788-827b-c0255f251eb2 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f370570c8b0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:32.159374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-efac1849-c1dd-47da-b2a0-6302dceb7d09 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.000630 Sep 08 16:15:32.165797 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 9/18] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:15:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 3005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:15:32.174739 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-668f7d93-868b-4354-87c2-46497da220a7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:32.189406 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-668f7d93-868b-4354-87c2-46497da220a7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:32.208516 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b408e0d3-3647-4788-827b-c0255f251eb2 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65" status: 200 len: 288 microversion: 2.1 time: 0.150341 Sep 08 16:15:32.212810 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Sep 8 16:15:32 2021] GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65 => generated 288 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:32.235041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-92edde59-a5e7-4ae2-8a88-35941a0e16c0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:32.240266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-92edde59-a5e7-4ae2-8a88-35941a0e16c0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:32.703998 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-92edde59-a5e7-4ae2-8a88-35941a0e16c0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:32.710085 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-668f7d93-868b-4354-87c2-46497da220a7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:32.765607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-668f7d93-868b-4354-87c2-46497da220a7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1213 microversion: 2.1 time: 0.602216 Sep 08 16:15:32.770280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-92edde59-a5e7-4ae2-8a88-35941a0e16c0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1218 microversion: 2.1 time: 0.554481 Sep 08 16:15:32.771802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 10/20] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:32 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1213 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:32.773736 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:32 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1218 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:32.789426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2ac55126-84e2-4b0a-b2a1-fdb6029fd6e7 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f3704835430>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.138483 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2ac55126-84e2-4b0a-b2a1-fdb6029fd6e7 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65" status: 202 len: 0 microversion: 2.1 time: 0.359453 Sep 08 16:15:33.140165 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Sep 8 16:15:32 2021] DELETE /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:15:33.151789 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-591f588b-e6a1-4552-a27b-6d0a473fd577 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f370570cb80>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.303584 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-591f588b-e6a1-4552-a27b-6d0a473fd577 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65" status: 200 len: 287 microversion: 2.1 time: 0.158636 Sep 08 16:15:33.305571 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Sep 8 16:15:33 2021] GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:33.789136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d6b2cfb0-1f43-4da0-a71c-3ecaabd14e84 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.790349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d6b2cfb0-1f43-4da0-a71c-3ecaabd14e84 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:33.802267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-eed41f08-1357-4875-a819-47fa6cb42c20 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.803066 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-eed41f08-1357-4875-a819-47fa6cb42c20 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:34.476502 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d6b2cfb0-1f43-4da0-a71c-3ecaabd14e84 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:34.500839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d6b2cfb0-1f43-4da0-a71c-3ecaabd14e84 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1213 microversion: 2.1 time: 0.706328 Sep 08 16:15:34.501514 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:33 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1213 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:34.520050 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ef721092-733d-4ea2-bd92-e3d7e6de966a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37050a5f70>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:34.578126 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-eed41f08-1357-4875-a819-47fa6cb42c20 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:34.626356 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-eed41f08-1357-4875-a819-47fa6cb42c20 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1218 microversion: 2.1 time: 0.811211 Sep 08 16:15:34.627694 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:33 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1218 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:34.632225 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-ef721092-733d-4ea2-bd92-e3d7e6de966a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] HTTP exception thrown: Snapshot ffdc9b8e-3a1e-4263-b72d-8cf523320c65 could not be found. Sep 08 16:15:34.633919 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ef721092-733d-4ea2-bd92-e3d7e6de966a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Returning 404 to user: Snapshot ffdc9b8e-3a1e-4263-b72d-8cf523320c65 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:34.635944 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ef721092-733d-4ea2-bd92-e3d7e6de966a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65" status: 404 len: 111 microversion: 2.1 time: 0.131216 Sep 08 16:15:34.637947 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Sep 8 16:15:34 2021] GET /compute/v2.1/os-snapshots/ffdc9b8e-3a1e-4263-b72d-8cf523320c65 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:34.649888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-21ae70c6-c4d5-4e66-9ee3-a7a218ccf493 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37047fcca0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:35.212473 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-21ae70c6-c4d5-4e66-9ee3-a7a218ccf493 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03" status: 202 len: 0 microversion: 2.1 time: 0.569384 Sep 08 16:15:35.213491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Sep 8 16:15:34 2021] DELETE /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:15:35.256641 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-261124aa-801c-4794-8e50-d1f7bdbbac3d tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f370575fee0>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:35.537931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:35.539507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:35.579313 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-261124aa-801c-4794-8e50-d1f7bdbbac3d tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] HTTP exception thrown: Volume c2efe72a-b196-438b-9b81-7fe5d2673d03 could not be found. Sep 08 16:15:35.580658 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-261124aa-801c-4794-8e50-d1f7bdbbac3d tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Returning 404 to user: Volume c2efe72a-b196-438b-9b81-7fe5d2673d03 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:35.581966 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-261124aa-801c-4794-8e50-d1f7bdbbac3d tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03" status: 404 len: 109 microversion: 2.1 time: 0.362660 Sep 08 16:15:35.582199 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:35.582904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:35.583659 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:35 2021] GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03 => generated 109 bytes in 365 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:35.602214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:35.603079 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:35.616818 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-033f4073-ea2d-4b16-8a0e-0422b213135a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37050a5040>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:35.845578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-033f4073-ea2d-4b16-8a0e-0422b213135a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] HTTP exception thrown: Volume c2efe72a-b196-438b-9b81-7fe5d2673d03 could not be found. Sep 08 16:15:35.847144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-033f4073-ea2d-4b16-8a0e-0422b213135a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Returning 404 to user: Volume c2efe72a-b196-438b-9b81-7fe5d2673d03 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:35.849111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-033f4073-ea2d-4b16-8a0e-0422b213135a tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03" status: 404 len: 109 microversion: 2.1 time: 0.249091 Sep 08 16:15:35.850517 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Sep 8 16:15:35 2021] DELETE /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03 => generated 109 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:35.881650 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:35.893574 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:35.943747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:35.944545 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:35.960037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:35.962772 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:36.793000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:36.858457 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:36.862808 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1b58ed68-9f5a-45dc-b10d-83828eb9af1c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1217 microversion: 2.1 time: 1.331120 Sep 08 16:15:36.884067 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 15/30] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:35 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1217 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:36.889543 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-65a13037-f878-498e-90f5-9b56654a6a21 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Calling method '.version_select at 0x7f37047854c0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:36.918903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c319630e-82be-4b1e-9a5e-a3aac6a58870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1270 microversion: 2.1 time: 1.066165 Sep 08 16:15:36.940041 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 16/31] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:35 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1270 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:37.138401 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-65a13037-f878-498e-90f5-9b56654a6a21 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] HTTP exception thrown: Volume c2efe72a-b196-438b-9b81-7fe5d2673d03 could not be found. Sep 08 16:15:37.144722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-65a13037-f878-498e-90f5-9b56654a6a21 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] Returning 404 to user: Volume c2efe72a-b196-438b-9b81-7fe5d2673d03 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:37.145897 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-65a13037-f878-498e-90f5-9b56654a6a21 tempest-VolumesSnapshotsTestJSON-309775055 tempest-VolumesSnapshotsTestJSON-309775055-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03" status: 404 len: 109 microversion: 2.1 time: 0.260632 Sep 08 16:15:37.146674 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 16/32] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:36 2021] GET /compute/v2.1/os-volumes/c2efe72a-b196-438b-9b81-7fe5d2673d03 => generated 109 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:37.905205 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:37.906677 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:37.917022 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:37.921078 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:37.922493 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:37.923183 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:37.957035 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:37.958488 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:37.982296 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:37.984560 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:37.997874 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:38.000661 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:38.756306 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:38.823647 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5554fd26-cd52-4837-bae9-492cc64d1079 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1276 microversion: 2.1 time: 0.867862 Sep 08 16:15:38.832449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:37 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1276 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:39.019382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:39.034162 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f9599af8-a1ea-46c9-928c-2efd26e87743 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1271 microversion: 2.1 time: 1.137760 Sep 08 16:15:39.051914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 17/34] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:37 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1271 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:39.862722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:39.863864 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:39.895797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:39.906528 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:39.907413 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:39.907921 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:40.066720 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:40.067727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:40.093137 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:40.093650 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:40.094419 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:40.094863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:40.924244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:40.935864 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e02a584b-4282-4813-90dd-1211bc09ebe2 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1271 microversion: 2.1 time: 0.873085 Sep 08 16:15:40.940622 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:40 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1271 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:41.091013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:41.167365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-44062c30-6f50-42d7-92cb-55b749ac0a71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1276 microversion: 2.1 time: 1.306433 Sep 08 16:15:41.175235 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 18/36] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:39 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1276 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:41.974240 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:41.975411 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:42.022327 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:42.023123 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:42.024687 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:42.046492 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:42.594467 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-08274a08-7754-4930-8044-cf333776fa8e tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Action: 'create', calling method: .version_select at 0x7f37047ca160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1024211266", "metadata": {"Type": "work"}}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:42.596680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-08274a08-7754-4930-8044-cf333776fa8e tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:42.597647 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-08274a08-7754-4930-8044-cf333776fa8e tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.687914 Sep 08 16:15:42.599605 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Sep 8 16:15:41 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 691 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:15:42.618601 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:42.619245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:42.646714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:42.647239 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:42.649027 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:42.649688 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:43.880415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:43.932487 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f486bbef-6ed9-480e-ad2c-86e099fb517c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1271 microversion: 2.1 time: 1.954655 Sep 08 16:15:43.936276 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 19/38] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:41 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1271 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:43.953327 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-895ebd27-fe47-40f5-ba08-b3542d7e8247 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Action: 'create', calling method: .version_select at 0x7f370477a430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-582269847", "metadata": {"Type": "work"}}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:43.955216 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-895ebd27-fe47-40f5-ba08-b3542d7e8247 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:43.956294 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-895ebd27-fe47-40f5-ba08-b3542d7e8247 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017761 Sep 08 16:15:43.958944 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Sep 8 16:15:43 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:15:43.967167 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b5ebc447-baf5-4c53-9e29-ac30338950c4 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Action: 'create', calling method: .version_select at 0x7f37047850d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-747414356", "metadata": {"Type": "work"}}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:43.971888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b5ebc447-baf5-4c53-9e29-ac30338950c4 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:43.973022 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b5ebc447-baf5-4c53-9e29-ac30338950c4 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009841 Sep 08 16:15:43.979735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Sep 8 16:15:43 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 16:15:43.990244 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dccc9bdd-c65c-43ae-a7d1-1fa8bfc0a7bd tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Calling method '.version_select at 0x7f3705059820>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:44.201055 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-dccc9bdd-c65c-43ae-a7d1-1fa8bfc0a7bd tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] HTTP exception thrown: Volume tempest-invalid-838281279 could not be found. Sep 08 16:15:44.201700 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dccc9bdd-c65c-43ae-a7d1-1fa8bfc0a7bd tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Returning 404 to user: Volume tempest-invalid-838281279 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:44.202555 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dccc9bdd-c65c-43ae-a7d1-1fa8bfc0a7bd tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-838281279" status: 404 len: 98 microversion: 2.1 time: 0.221355 Sep 08 16:15:44.203366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 22/41] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Sep 8 16:15:43 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-838281279 => generated 98 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 16:15:44.215541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3fb04f1f-2d68-4639-a2f5-0deceba570d7 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004584 Sep 08 16:15:44.216275 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 23/42] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Sep 8 16:15:44 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 08 16:15:44.230131 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-07858a00-6bf4-4bd6-8ae2-054ae8f4450c tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003952 Sep 08 16:15:44.233959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 24/43] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Sep 8 16:15:44 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 16:15:44.245701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9a1a3e3e-f91d-4f70-8e96-efb6cc78a445 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Calling method '.version_select at 0x7f370478f940>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:44.554906 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-9a1a3e3e-f91d-4f70-8e96-efb6cc78a445 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] HTTP exception thrown: Volume aa0bfb0b-b7f0-4030-9558-b06098ed41aa could not be found. Sep 08 16:15:44.555537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9a1a3e3e-f91d-4f70-8e96-efb6cc78a445 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Returning 404 to user: Volume aa0bfb0b-b7f0-4030-9558-b06098ed41aa could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:44.557030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9a1a3e3e-f91d-4f70-8e96-efb6cc78a445 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/aa0bfb0b-b7f0-4030-9558-b06098ed41aa" status: 404 len: 109 microversion: 2.1 time: 0.317826 Sep 08 16:15:44.558734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 25/44] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Sep 8 16:15:44 2021] DELETE /compute/v2.1/os-volumes/aa0bfb0b-b7f0-4030-9558-b06098ed41aa => generated 109 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:15:44.577939 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-84a0a750-031d-4642-8cfa-a752fd922451 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Calling method '.version_select at 0x7f37050ffaf0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:45.039380 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-84a0a750-031d-4642-8cfa-a752fd922451 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] HTTP exception thrown: Volume a27f1c07-607e-4892-b348-4d8c9d6a64f8 could not be found. Sep 08 16:15:45.042728 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-84a0a750-031d-4642-8cfa-a752fd922451 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] Returning 404 to user: Volume a27f1c07-607e-4892-b348-4d8c9d6a64f8 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:15:45.049267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-84a0a750-031d-4642-8cfa-a752fd922451 tempest-VolumesNegativeTest-2095641493 tempest-VolumesNegativeTest-2095641493-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a27f1c07-607e-4892-b348-4d8c9d6a64f8" status: 404 len: 109 microversion: 2.1 time: 0.476134 Sep 08 16:15:45.059978 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 26/45] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:15:44 2021] GET /compute/v2.1/os-volumes/a27f1c07-607e-4892-b348-4d8c9d6a64f8 => generated 109 bytes in 488 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:45.098859 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:45.114071 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:45.160271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:45.171538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:45.175544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:45.184633 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:46.211229 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:46.225685 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-299303fa-bd38-47a1-966d-d48c5bcb820c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1271 microversion: 2.1 time: 1.163704 Sep 08 16:15:46.233696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 27/46] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:45 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1271 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:46.546880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:46.571594 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-10ebb755-28e6-4cd3-9678-e2e522a3cfb2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 3.968145 Sep 08 16:15:46.576232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 20/47] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:42 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 3976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:47.268941 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:47.276342 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:47.305817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:47.308587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:47.311145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:47.312695 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:47.600184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:47.600955 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:47.617655 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:47.618169 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:47.624004 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:47.626749 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:50.427003 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:50.453809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-aa482104-bb67-4c4f-aaee-4b6ab5d33b3c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 3.198955 Sep 08 16:15:50.458707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 28/48] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:47 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:50.718849 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:50.800654 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-19716acd-2105-454b-a099-57f881b9ac32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 3.204291 Sep 08 16:15:50.831908 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 21/49] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:47 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 3237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:51.477015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:51.477846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:51.507814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:51.509874 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:51.513427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:51.522418 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:51.831144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:51.832748 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:51.849006 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:51.851030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:51.853476 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:51.855408 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:53.822763 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:53.862207 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9028fefb-e967-46df-b81f-d00f5563842d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 2.035470 Sep 08 16:15:53.884283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 22/50] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:51 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:54.108984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:54.131046 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-16fe1464-9028-4058-8ccc-12081d43eae7 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 2.652773 Sep 08 16:15:54.132814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 29/51] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:51 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:54.465627 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-254cea28-19e9-4d64-8d10-a5e222bdab27 req-75c30fce-255d-4f0c-85f8-fd4de46338bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5667d820-d623-4b13-af5f-cee38599c046", "tag": "7cbd5dee-f58a-4b80-ad1f-8953c26b4057"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:54.468681 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:15:54.468681 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:15:54.497791 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-254cea28-19e9-4d64-8d10-a5e222bdab27 req-75c30fce-255d-4f0c-85f8-fd4de46338bc service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:54.500085 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-254cea28-19e9-4d64-8d10-a5e222bdab27 req-75c30fce-255d-4f0c-85f8-fd4de46338bc service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:54.563923 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-254cea28-19e9-4d64-8d10-a5e222bdab27 req-75c30fce-255d-4f0c-85f8-fd4de46338bc service nova] Creating event network-changed:7cbd5dee-f58a-4b80-ad1f-8953c26b4057 for instance 5667d820-d623-4b13-af5f-cee38599c046 on hv-cinder-80789 Sep 08 16:15:54.564846 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-254cea28-19e9-4d64-8d10-a5e222bdab27 req-75c30fce-255d-4f0c-85f8-fd4de46338bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=93617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 08 16:15:54.572185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c1eaa76-0b72-4572-9d0b-47eee49985cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:54.572916 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c1eaa76-0b72-4572-9d0b-47eee49985cf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:54.574572 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c1eaa76-0b72-4572-9d0b-47eee49985cf None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:54.575304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c1eaa76-0b72-4572-9d0b-47eee49985cf None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:54.598936 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.compute.rpcapi [None req-1c1eaa76-0b72-4572-9d0b-47eee49985cf None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Sep 08 16:15:54.605593 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c1eaa76-0b72-4572-9d0b-47eee49985cf None None] Releasing lock "compute-rpcapi-router" {{(pid=93617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 08 16:15:54.673019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1c1eaa76-0b72-4572-9d0b-47eee49985cf None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.786424 Sep 08 16:15:54.676535 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 23/52] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:54.832980 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2096559616", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5411d955-3db9-47e2-83ab-d4abbd225415"}]}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:54.918885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:54.934339 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:55.000310 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:55.001799 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:55.008002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:55.009106 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:55.063361 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] validate_networks() for [('5411d955-3db9-47e2-83ab-d4abbd225415', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:15:57.314612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:57.324341 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8504b18f-bb87-47bd-88df-02e4cd390d5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 2.414248 Sep 08 16:15:57.326291 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 24/53] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:54 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:57.337025 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:57.337652 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:15:57.360679 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:57.361211 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:57.365099 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:57.365897 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:58.169261 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:58.182198 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c22c60c7-3ad1-4d2e-a6b6-a72fcd9b06f1 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 0.854742 Sep 08 16:15:58.183625 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 25/54] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:15:57 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:58.855531 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-94e15189-3f2c-4a7f-aeda-3acd9e8f2385 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'create', calling method: .version_select at 0x7f370475f670>, body: {"keypair": {"name": "tempest-keypair-535086486"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:58.919273 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-94e15189-3f2c-4a7f-aeda-3acd9e8f2385 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:15:58.930369 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-94e15189-3f2c-4a7f-aeda-3acd9e8f2385 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for user e8b8e261b03145bbbb513a7044de5211 and project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:15:59.356889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-94e15189-3f2c-4a7f-aeda-3acd9e8f2385 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:15:59.364811 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-94e15189-3f2c-4a7f-aeda-3acd9e8f2385 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for user e8b8e261b03145bbbb513a7044de5211 and project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:15:59.397993 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-94e15189-3f2c-4a7f-aeda-3acd9e8f2385 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.212926 Sep 08 16:15:59.399143 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 26/55] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Sep 8 16:15:58 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1215 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:15:59.717790 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:15:59.718611 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:15:59.719329 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:15:59.721157 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:15:59.722011 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:15:59.755821 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:59.756598 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:59.758191 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:15:59.758948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:15:59.850582 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Getting quotas for project 3abc28c3a0c44587b1e4367f9363241d. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:15:59.873255 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Getting quotas for user 99f125cc545a40929c6bfa8997ccd041 and project 3abc28c3a0c44587b1e4367f9363241d. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:15:59.951338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:15:59.957052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:16:00.075585 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d8584a19-dfc9-4735-be70-f76845b6880d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'create', calling method: .version_select at 0x7f3704774b80>, body: {"keypair": {"name": "tempest-keypair-475915403"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:00.140615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-d8584a19-dfc9-4735-be70-f76845b6880d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:16:00.155191 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f3cc3571-f2a1-49ef-a387-267508a1cc80 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.943004 Sep 08 16:16:00.156402 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 30/56] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:15:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 5958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:16:00.156607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-d8584a19-dfc9-4735-be70-f76845b6880d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for user 3fe3a59305f044fa87cd6a1cb91d8e0c and project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:16:00.727913 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-d8584a19-dfc9-4735-be70-f76845b6880d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:16:00.755930 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-d8584a19-dfc9-4735-be70-f76845b6880d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for user 3fe3a59305f044fa87cd6a1cb91d8e0c and project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:16:00.872759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d8584a19-dfc9-4735-be70-f76845b6880d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.466481 Sep 08 16:16:00.872759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 27/57] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Sep 8 16:15:59 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:00.903608 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:00.908680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:00.956742 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:00.965877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:00.976634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:00.991030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:01.103032 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-45e326c6-3778-466b-8197-5c64dbeed8ad req-e9214fd6-6e78-47f4-89a5-a77e7863fa70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b195b8-bfe8-41df-869b-6898cf9164ec", "tag": "9bbcf2be-3721-436a-98a5-308ffff99b29"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:01.125798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:01.125798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:01.182534 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-45e326c6-3778-466b-8197-5c64dbeed8ad req-e9214fd6-6e78-47f4-89a5-a77e7863fa70 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:01.184579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-45e326c6-3778-466b-8197-5c64dbeed8ad req-e9214fd6-6e78-47f4-89a5-a77e7863fa70 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:01.229261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-45e326c6-3778-466b-8197-5c64dbeed8ad req-e9214fd6-6e78-47f4-89a5-a77e7863fa70 service nova] Creating event network-changed:9bbcf2be-3721-436a-98a5-308ffff99b29 for instance c9b195b8-bfe8-41df-869b-6898cf9164ec on hv-cinder-80789 Sep 08 16:16:01.231179 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-45e326c6-3778-466b-8197-5c64dbeed8ad req-e9214fd6-6e78-47f4-89a5-a77e7863fa70 service nova] Acquired lock "compute-rpcapi-router" {{(pid=93618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 08 16:16:01.233699 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8c1de490-0f24-4fb9-b7b0-6537bb94bb3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:01.234778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8c1de490-0f24-4fb9-b7b0-6537bb94bb3c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:01.236961 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8c1de490-0f24-4fb9-b7b0-6537bb94bb3c None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:01.238749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8c1de490-0f24-4fb9-b7b0-6537bb94bb3c None None] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:01.286130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.compute.rpcapi [None req-8c1de490-0f24-4fb9-b7b0-6537bb94bb3c None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Sep 08 16:16:01.288616 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8c1de490-0f24-4fb9-b7b0-6537bb94bb3c None None] Releasing lock "compute-rpcapi-router" {{(pid=93618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 08 16:16:01.441456 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8c1de490-0f24-4fb9-b7b0-6537bb94bb3c None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.281018 Sep 08 16:16:01.442966 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 31/58] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:01.456333 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:01.465629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:01.500847 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:01.502745 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:01.506134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:01.512613 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:03.270851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:03.305538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a4cc02a1-a469-4a86-b959-b38992b0a89c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 1.860633 Sep 08 16:16:03.306154 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:01 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:03.322980 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:03.331142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:03.359855 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:03.371334 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:03.372631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:03.374561 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:03.376575 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:03.380617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-70b5fbee-3e6c-44f1-91b6-6e4d5bc12586 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 2.498501 Sep 08 16:16:03.383225 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 28/60] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:00 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:03.886889 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:03.906654 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-25b17737-366a-4df0-9618-78a9227a5ca1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1274 microversion: 2.1 time: 0.597820 Sep 08 16:16:03.908180 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 33/61] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:03 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1274 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:04.233525 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1129600396", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5411d955-3db9-47e2-83ab-d4abbd225415"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:04.332165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:04.332777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:04.370605 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:04.372547 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:04.377436 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:04.387569 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:04.426993 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] validate_networks() for [('5411d955-3db9-47e2-83ab-d4abbd225415', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:16:06.284044 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:06.309984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b670e959-0693-4906-af27-236821727fca tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 1.982114 Sep 08 16:16:06.329152 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 34/62] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:04 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:06.341855 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:06.343280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:06.361712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:06.362811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:06.365060 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:06.366211 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:07.504238 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:07.543178 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-df4d6b08-d230-45c2-b93a-2e62d64d9fd1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 1.200897 Sep 08 16:16:07.552232 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 35/63] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:06 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:07.569323 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:07.570801 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:07.600945 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:07.602142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:07.615365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:07.616661 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:07.703518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:16:07.704388 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:16:07.705119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:16:07.706642 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:16:07.708965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:16:07.779607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:07.780448 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:07.793523 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:07.803146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:07.953845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Getting quotas for project 3abc28c3a0c44587b1e4367f9363241d. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:16:07.961884 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Getting quotas for user 99f125cc545a40929c6bfa8997ccd041 and project 3abc28c3a0c44587b1e4367f9363241d. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:16:08.001656 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:16:08.008376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:16:08.217346 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-299fd22a-8ecc-45e0-acca-5d5cd1890f50 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.990297 Sep 08 16:16:08.218624 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 29/64] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:16:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 3993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:16:08.232712 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e85e229d-e309-4af1-b3ed-9b475691bf5f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:08.233592 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e85e229d-e309-4af1-b3ed-9b475691bf5f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:08.473224 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-e85e229d-e309-4af1-b3ed-9b475691bf5f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:08.500990 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e85e229d-e309-4af1-b3ed-9b475691bf5f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1222 microversion: 2.1 time: 0.272741 Sep 08 16:16:08.518188 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 30/65] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:08 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1222 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:08.585163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:08.594181 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:08.621854 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:08.626439 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:08.628900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:08.631449 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:08.805432 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:08.820099 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3a1e5344-7b33-4006-be74-b13565116220 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 1.265471 Sep 08 16:16:08.820972 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 36/66] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:07 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:09.519767 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:09.520572 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:09.539511 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:09.540485 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:09.556861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:09.558145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:09.591328 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:09.639176 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5a1ed3c0-4483-4ced-b268-594c885beafd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 1.035140 Sep 08 16:16:09.659251 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 31/67] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:08 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:09.840673 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:09.841785 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:09.865618 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:09.866512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:09.875819 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:09.877685 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:10.200617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:10.238494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5bda967e-bca0-46b1-b0f5-bb6eaf5d7756 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1218 microversion: 2.1 time: 0.722735 Sep 08 16:16:10.244741 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 37/68] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:09 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1218 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:10.286557 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1836482019", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "582096af-2f90-402d-b754-a13d85dcf0f9"}], "security_groups": [{"name": "tempest-securitygroup--2103706778"}], "key_name": "tempest-keypair-475915403", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:12.138390 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] validate_networks() for [('582096af-2f90-402d-b754-a13d85dcf0f9', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:16:12.590670 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:12.603199 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-54492fb3-cea8-420e-bcd0-3b7e0ae186e6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 2.767694 Sep 08 16:16:12.608617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 32/69] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:09 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 2774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:12.613993 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:12.620737 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:12.645851 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:12.647948 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:12.650842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:12.651749 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:13.863104 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:13.886427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3758cbb9-d5cb-45ce-bbae-36ce54ef20fc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 1.275369 Sep 08 16:16:13.903501 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 33/70] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:12 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:13.916194 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:13.917615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:13.962551 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:13.964843 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:13.966423 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:13.967280 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:14.175571 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:14.194447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6ba00f1a-485c-461f-b4b7-32ac112d6dd7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1280 microversion: 2.1 time: 0.288815 Sep 08 16:16:14.196130 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 34/71] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:13 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:14.285184 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:16:14.286086 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:16:14.287252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:16:14.288125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:16:14.289307 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:16:14.331253 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:14.332245 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:14.336446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:14.338929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:14.400885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:16:14.408370 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for user 3fe3a59305f044fa87cd6a1cb91d8e0c and project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:16:14.438009 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:16:14.443002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:16:14.466258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-6601ee95-e0eb-4a18-8fd4-38e360d2aa82 req-a39162f1-7dbe-4453-9636-c2180fb595c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5667d820-d623-4b13-af5f-cee38599c046", "name": "network-vif-plugged", "status": "completed", "tag": "7cbd5dee-f58a-4b80-ad1f-8953c26b4057"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:14.470895 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:14.470895 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:16:14.493857 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-6601ee95-e0eb-4a18-8fd4-38e360d2aa82 req-a39162f1-7dbe-4453-9636-c2180fb595c2 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:14.498382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-6601ee95-e0eb-4a18-8fd4-38e360d2aa82 req-a39162f1-7dbe-4453-9636-c2180fb595c2 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:14.545664 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-6601ee95-e0eb-4a18-8fd4-38e360d2aa82 req-a39162f1-7dbe-4453-9636-c2180fb595c2 service nova] Creating event network-vif-plugged:7cbd5dee-f58a-4b80-ad1f-8953c26b4057 for instance 5667d820-d623-4b13-af5f-cee38599c046 on hv-cinder-80789 Sep 08 16:16:14.549512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2a347b75-c751-4638-be07-20f9e59b50a5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.298212 Sep 08 16:16:14.554364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 38/72] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:16:10 2021] POST /compute/v2.1/servers => generated 402 bytes in 4305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:16:14.562650 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-6601ee95-e0eb-4a18-8fd4-38e360d2aa82 req-a39162f1-7dbe-4453-9636-c2180fb595c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.363853 Sep 08 16:16:14.563030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 35/73] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:14.574989 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-c855701b-6d09-4767-a4ee-aea9cab92176 req-4a13de80-f2e5-47f5-bcca-66be2c38acfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025be250-ed13-4171-af63-942ce76ab60a", "tag": "59e7e543-15da-4662-9f0c-ec72acd13a77"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:14.578312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-325399227", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75dd61b0-379a-4abd-83d0-357fccbfe480"}], "security_groups": [{"name": "tempest-securitygroup--124934172"}], "key_name": "tempest-keypair-535086486", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:14.593838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:14.593838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:16:14.623362 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-c855701b-6d09-4767-a4ee-aea9cab92176 req-4a13de80-f2e5-47f5-bcca-66be2c38acfc service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:14.631890 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-c855701b-6d09-4767-a4ee-aea9cab92176 req-4a13de80-f2e5-47f5-bcca-66be2c38acfc service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:14.663662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-c855701b-6d09-4767-a4ee-aea9cab92176 req-4a13de80-f2e5-47f5-bcca-66be2c38acfc service nova] Creating event network-changed:59e7e543-15da-4662-9f0c-ec72acd13a77 for instance 025be250-ed13-4171-af63-942ce76ab60a on hv-cinder-80789 Sep 08 16:16:14.677979 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-c855701b-6d09-4767-a4ee-aea9cab92176 req-4a13de80-f2e5-47f5-bcca-66be2c38acfc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113167 Sep 08 16:16:14.680821 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 36/74] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:14.690583 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:14.692741 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:14.731747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:14.739037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:14.740752 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:14.741742 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:15.806378 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] validate_networks() for [('75dd61b0-379a-4abd-83d0-357fccbfe480', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:16:16.460599 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:16.479541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9f8c5e66-2025-4209-b132-c83fc53c3f98 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 1.796510 Sep 08 16:16:16.488900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 37/75] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:14 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:16.500627 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:16.506827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:16.530639 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:16.531962 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:16.535027 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:16.536216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:16.873319 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:16.908345 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5b861fea-f472-45b5-9c82-afad9b6890c9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1233 microversion: 2.1 time: 0.409724 Sep 08 16:16:16.909845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:16 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1233 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:16.917661 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:16.918688 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:16.950816 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:16.951597 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:16.952992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:16.953748 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:17.715262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:17.743368 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-70de19b6-83c0-4fd2-9818-e9d454cbbd3c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1318 microversion: 2.1 time: 0.832007 Sep 08 16:16:17.745865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 39/77] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:16 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:17.755967 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:17.756600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:17.766485 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:17.769142 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:17.782877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:17.784139 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:18.585512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:16:18.586224 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:16:18.587056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:16:18.587822 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:16:18.589068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:16:18.619297 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:18.625927 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:18.627797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:18.628865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:18.668038 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for project 8151b8f5193c4e4eb58002780ae62270. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:16:18.692398 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for user e8b8e261b03145bbbb513a7044de5211 and project 8151b8f5193c4e4eb58002780ae62270. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:16:18.720487 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:16:18.723688 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:16:18.873077 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-823603b6-b93b-45f7-afb0-a5a2e00dfe4f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.315686 Sep 08 16:16:18.886730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 39/78] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Sep 8 16:16:14 2021] POST /compute/v2.1/servers => generated 401 bytes in 4331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 16:16:18.899940 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-52438062-0dcf-49e3-a5bd-d0d2f8d85a3f req-fc40b211-c549-47af-a2e8-e84df4f4bb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b195b8-bfe8-41df-869b-6898cf9164ec", "name": "network-vif-plugged", "status": "completed", "tag": "9bbcf2be-3721-436a-98a5-308ffff99b29"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:18.905424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:18.905424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:18.984376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-52438062-0dcf-49e3-a5bd-d0d2f8d85a3f req-fc40b211-c549-47af-a2e8-e84df4f4bb2c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:18.985557 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-52438062-0dcf-49e3-a5bd-d0d2f8d85a3f req-fc40b211-c549-47af-a2e8-e84df4f4bb2c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:19.039068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-52438062-0dcf-49e3-a5bd-d0d2f8d85a3f req-fc40b211-c549-47af-a2e8-e84df4f4bb2c service nova] Creating event network-vif-plugged:9bbcf2be-3721-436a-98a5-308ffff99b29 for instance c9b195b8-bfe8-41df-869b-6898cf9164ec on hv-cinder-80789 Sep 08 16:16:19.062475 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:19.083147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-52438062-0dcf-49e3-a5bd-d0d2f8d85a3f req-fc40b211-c549-47af-a2e8-e84df4f4bb2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191350 Sep 08 16:16:19.089790 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 40/79] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:19.112900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e30a9266-9a4c-40e0-b55a-c1d388b4a2b5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1322 microversion: 2.1 time: 1.367384 Sep 08 16:16:19.114627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:19.117906 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 40/80] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:17 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1322 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:19.118510 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:19.150143 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:19.156228 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:19.173902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:19.174769 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:19.180234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:19.181926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:19.196308 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:19.200548 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:19.202977 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:19.204610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:20.796783 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:20.812779 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:20.817213 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f99b6189-70ce-40ed-b215-a0239ec2c6d3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 1.691999 Sep 08 16:16:20.818992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 41/81] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:19 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:20.831144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:20.832568 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:20.838196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-cd278b7a-efe5-49df-9486-b169bf016223 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1313 microversion: 2.1 time: 1.744054 Sep 08 16:16:20.840535 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:19 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1313 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:20.848959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:20.850011 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:20.853086 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:20.853806 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:20.856444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:20.857626 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:20.862237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:20.873023 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:20.874562 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:20.875932 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:21.278219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:21.340523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:21.343719 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:21.356742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0d6a3a37-851d-48cf-8313-b4059fc4d4a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1276 microversion: 2.20 time: 0.513596 Sep 08 16:16:21.359713 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 42/83] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:20 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1276 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:21.380595 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-52bbf536-ce4b-4124-81bb-0afadf6ea0a7 req-fa244332-3235-4d61-be40-e3642c120ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccdab9af-f621-453f-9905-a59a53ee671c", "tag": "78b9175d-18a8-472a-b285-f0a5f252604e"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:21.384083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:21.384083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:21.420968 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-52bbf536-ce4b-4124-81bb-0afadf6ea0a7 req-fa244332-3235-4d61-be40-e3642c120ad5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:21.421575 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-52bbf536-ce4b-4124-81bb-0afadf6ea0a7 req-fa244332-3235-4d61-be40-e3642c120ad5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:21.491840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-52bbf536-ce4b-4124-81bb-0afadf6ea0a7 req-fa244332-3235-4d61-be40-e3642c120ad5 service nova] Creating event network-changed:78b9175d-18a8-472a-b285-f0a5f252604e for instance ccdab9af-f621-453f-9905-a59a53ee671c on hv-cinder-80789 Sep 08 16:16:21.508131 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-52bbf536-ce4b-4124-81bb-0afadf6ea0a7 req-fa244332-3235-4d61-be40-e3642c120ad5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145290 Sep 08 16:16:21.512294 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 43/84] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:21.524824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:21.527368 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:21.546800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:21.547898 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:21.549107 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:21.550294 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:21.955297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:21.978724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5a1d6e9e-7f4d-4f8b-927e-4a4c2fb67ccc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1507 microversion: 2.1 time: 1.157609 Sep 08 16:16:21.990704 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:20 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1507 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:22.016197 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-03c21ed5-6e4a-462f-bf04-ccf84641a2b2 req-aba46d34-3d15-4db5-bc1e-4aaeb2445657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025be250-ed13-4171-af63-942ce76ab60a", "name": "network-vif-plugged", "status": "completed", "tag": "59e7e543-15da-4662-9f0c-ec72acd13a77"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:22.020212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:22.020212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:16:22.056523 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-03c21ed5-6e4a-462f-bf04-ccf84641a2b2 req-aba46d34-3d15-4db5-bc1e-4aaeb2445657 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:22.057637 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-03c21ed5-6e4a-462f-bf04-ccf84641a2b2 req-aba46d34-3d15-4db5-bc1e-4aaeb2445657 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:22.159997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-03c21ed5-6e4a-462f-bf04-ccf84641a2b2 req-aba46d34-3d15-4db5-bc1e-4aaeb2445657 service nova] Creating event network-vif-plugged:59e7e543-15da-4662-9f0c-ec72acd13a77 for instance 025be250-ed13-4171-af63-942ce76ab60a on hv-cinder-80789 Sep 08 16:16:22.191712 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-03c21ed5-6e4a-462f-bf04-ccf84641a2b2 req-aba46d34-3d15-4db5-bc1e-4aaeb2445657 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194035 Sep 08 16:16:22.199577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 43/86] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:22.220136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:22.221423 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:22.295130 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:22.295958 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:22.297306 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:22.298061 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:23.064906 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:23.113817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3aef2d79-e56c-4948-8c5a-6b267d41b494 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1322 microversion: 2.1 time: 1.594927 Sep 08 16:16:23.118660 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 44/87] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:21 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1322 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:23.146345 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:23.148034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:23.189065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:23.191265 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:23.195572 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:23.196839 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:23.496899 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:23.514583 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8f24084a-04db-4dd6-8f9d-66dad4b5d298 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 1.313051 Sep 08 16:16:23.522589 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 44/88] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:22 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:23.537290 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-dc94a053-37c5-489d-bd6c-09f7ea50defd req-a4e1afc2-9d71-4c67-acdc-5764dae60f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db24e43-208d-4d9e-a75c-98f3168ab156", "tag": "ada104b9-d491-45ae-a144-07da180661e5"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:23.552356 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:23.552356 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:16:23.571314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-dc94a053-37c5-489d-bd6c-09f7ea50defd req-a4e1afc2-9d71-4c67-acdc-5764dae60f44 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:23.571786 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-dc94a053-37c5-489d-bd6c-09f7ea50defd req-a4e1afc2-9d71-4c67-acdc-5764dae60f44 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:23.624123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-dc94a053-37c5-489d-bd6c-09f7ea50defd req-a4e1afc2-9d71-4c67-acdc-5764dae60f44 service nova] Creating event network-changed:ada104b9-d491-45ae-a144-07da180661e5 for instance 3db24e43-208d-4d9e-a75c-98f3168ab156 on hv-cinder-80789 Sep 08 16:16:23.631499 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-dc94a053-37c5-489d-bd6c-09f7ea50defd req-a4e1afc2-9d71-4c67-acdc-5764dae60f44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107515 Sep 08 16:16:23.632119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 45/89] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:23.647048 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:23.647801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:23.666387 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:23.667001 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:23.667977 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:23.668579 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:23.956815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:23.990655 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:23.997555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:24.000147 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a2bbadec-dbae-43ca-b3d2-0e5e53cd1ba3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1338 microversion: 2.20 time: 0.361568 Sep 08 16:16:24.003223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 46/90] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:23 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1338 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:24.137820 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:24.138594 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:24.148666 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:24.149378 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:24.150347 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:24.151046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:24.636444 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:24.655755 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1411d65e-0f58-4e1c-9ce8-c729957d6c6d tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1501 microversion: 2.1 time: 1.531616 Sep 08 16:16:24.657768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 45/91] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:23 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1501 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:24.683949 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:24.685811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:24.702470 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:24.703431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:24.705250 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:24.706448 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:25.282776 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:25.349345 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f5331e80-0363-4e2d-ba00-c12ed6a90d1a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1322 microversion: 2.1 time: 1.216027 Sep 08 16:16:25.351874 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 47/92] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:24 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1322 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:25.375328 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3e407856-7f6c-48a0-9d35-12dab2def9ac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "253bedc9-06eb-486f-8e83-71cae3fac0a3"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:25.376755 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3e407856-7f6c-48a0-9d35-12dab2def9ac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:25.394977 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e407856-7f6c-48a0-9d35-12dab2def9ac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:25.397339 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e407856-7f6c-48a0-9d35-12dab2def9ac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:25.402434 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e407856-7f6c-48a0-9d35-12dab2def9ac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:25.403831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e407856-7f6c-48a0-9d35-12dab2def9ac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:25.735959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:25.771791 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-33ea9bd8-e8bf-4b32-9adb-1b238a8b17ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 1.110946 Sep 08 16:16:25.775543 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 46/93] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:24 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:25.808711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:25.810431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:25.857934 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:25.859262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:25.862735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:25.864816 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:26.605968 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:26.655252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:26.664025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:26.666084 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1c8ac014-be0e-44d1-83bf-dff85327c81a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.879705 Sep 08 16:16:26.667712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 47/94] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:25 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:26.684129 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:26.690959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:26.725830 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:26.726641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:26.728137 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:26.729633 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:26.834179 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3e407856-7f6c-48a0-9d35-12dab2def9ac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.480374 Sep 08 16:16:26.834942 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 48/95] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:16:25 2021] POST /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments => generated 194 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:26.863994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:26.865335 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:26.889111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:26.889444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:26.896599 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:26.898621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:28.153664 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:28.179820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-03468f7b-93fb-4a3c-ac1b-74ee2bdcb803 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1322 microversion: 2.1 time: 1.501400 Sep 08 16:16:28.183038 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 48/96] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:26 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1322 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:28.195240 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:28.198461 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:28.215133 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:28.216007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:28.217711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:28.218628 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:28.252172 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:28.267461 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-70cbe7d0-6e4b-448a-8cad-1b2a6f13c986 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 1.431188 Sep 08 16:16:28.270470 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 49/97] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:26 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:28.288501 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-90f6235d-0968-4084-818f-3f971253a899 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14244a1e-aa6d-49c6-bd93-57e755b376c9"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:28.290429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-90f6235d-0968-4084-818f-3f971253a899 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:28.306448 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90f6235d-0968-4084-818f-3f971253a899 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:28.308159 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90f6235d-0968-4084-818f-3f971253a899 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:28.309943 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90f6235d-0968-4084-818f-3f971253a899 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:28.310630 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90f6235d-0968-4084-818f-3f971253a899 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:29.068604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-90f6235d-0968-4084-818f-3f971253a899 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "POST /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795571 Sep 08 16:16:29.069262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 50/98] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:16:28 2021] POST /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:29.084133 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:29.106729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:29.113319 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:29.116861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a3a94c36-14e6-4b7f-86c2-c08d55623b80 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.929830 Sep 08 16:16:29.121842 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 49/99] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:28 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:29.215676 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:29.216756 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:29.244367 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:29.245060 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:29.248875 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:29.249493 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:29.303453 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:29.305019 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:29.327074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:29.329121 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:29.331052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:29.337130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:30.236964 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:30.256064 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:30.299093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d178530d-fe4a-472a-a7b6-ad3bca9745cc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 0.997607 Sep 08 16:16:30.321656 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 50/100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:29 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:30.324511 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-81ebfce7-7777-4783-86d0-eaf8ca102e2c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1322 microversion: 2.1 time: 1.114706 Sep 08 16:16:30.350764 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-a0e534fd-d676-4365-b20b-6bcd76d772ef req-4bd3ae65-5da2-4f79-8dfe-8c2c62275eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccdab9af-f621-453f-9905-a59a53ee671c", "name": "network-vif-plugged", "status": "completed", "tag": "78b9175d-18a8-472a-b285-f0a5f252604e"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:30.353138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:30.353138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:30.356061 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:29 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1322 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:30.377397 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-a0e534fd-d676-4365-b20b-6bcd76d772ef req-4bd3ae65-5da2-4f79-8dfe-8c2c62275eca service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:30.380581 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-a0e534fd-d676-4365-b20b-6bcd76d772ef req-4bd3ae65-5da2-4f79-8dfe-8c2c62275eca service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:30.388564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:30.389824 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:30.408849 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:30.409900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:30.411651 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:30.412994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:30.433795 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-a0e534fd-d676-4365-b20b-6bcd76d772ef req-4bd3ae65-5da2-4f79-8dfe-8c2c62275eca service nova] Creating event network-vif-plugged:78b9175d-18a8-472a-b285-f0a5f252604e for instance ccdab9af-f621-453f-9905-a59a53ee671c on hv-cinder-80789 Sep 08 16:16:30.452509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-a0e534fd-d676-4365-b20b-6bcd76d772ef req-4bd3ae65-5da2-4f79-8dfe-8c2c62275eca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129050 Sep 08 16:16:30.453127 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 51/102] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:30.464681 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-d31e0582-6d68-4fe3-9e79-65960fa5ed25 req-cd92cd2d-b67d-4f66-8d34-b01a470122e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dd36a3-a4b2-4d0e-8140-e629d0c9954d", "tag": "625c811b-4427-4c32-9c2e-61a56adb42db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:30.513885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:30.513885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:30.547652 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d31e0582-6d68-4fe3-9e79-65960fa5ed25 req-cd92cd2d-b67d-4f66-8d34-b01a470122e6 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:30.548871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d31e0582-6d68-4fe3-9e79-65960fa5ed25 req-cd92cd2d-b67d-4f66-8d34-b01a470122e6 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:30.633923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-d31e0582-6d68-4fe3-9e79-65960fa5ed25 req-cd92cd2d-b67d-4f66-8d34-b01a470122e6 service nova] Creating event network-changed:625c811b-4427-4c32-9c2e-61a56adb42db for instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d on hv-cinder-80789 Sep 08 16:16:30.669552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-d31e0582-6d68-4fe3-9e79-65960fa5ed25 req-cd92cd2d-b67d-4f66-8d34-b01a470122e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209579 Sep 08 16:16:30.673394 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 52/103] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:31.270469 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:31.296108 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:31.296108 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:31.296860 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-29bba44e-2cde-4b63-b63a-ebfb7ecb5944 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.936396 Sep 08 16:16:31.310600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 52/104] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:30 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:31.335783 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:31.339033 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:31.360221 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:31.360849 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:31.377937 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:31.378478 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:31.379314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:31.386968 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:31.390946 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:31.393365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:31.400034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:31.402267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:32.033551 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:32.042997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-83939eff-8792-47f6-98b9-bcd19c5ad9a2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1322 microversion: 2.1 time: 0.687096 Sep 08 16:16:32.048611 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 53/105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:31 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1322 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:32.069971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:32.082157 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0946d894-372e-49aa-8904-b5b5ff56eda5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 0.755771 Sep 08 16:16:32.084509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 53/106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:31 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:32.317899 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:32.318677 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:32.333244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:32.333720 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:32.334527 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:32.334969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:32.733196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:32.757092 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:32.761017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:32.763026 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6367d02f-c166-424a-ba17-bcac4387931f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.449208 Sep 08 16:16:32.764711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 54/107] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:32 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:16:33.070278 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:33.075545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:33.094900 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:33.096150 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:33.099450 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:33.114338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:33.115511 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:33.120835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:33.160678 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:33.161536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:33.163744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:33.164539 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:34.128067 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:34.147775 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ab081bc7-be7b-43df-b135-aadc41fa9405 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1322 microversion: 2.1 time: 1.086095 Sep 08 16:16:34.149300 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 54/108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:33 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1322 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:34.150153 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:34.154812 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:34.156030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:34.172325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:34.173341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:34.179195 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0718f39a-bc6b-430c-8fdf-1edfd97e84ed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 1.076782 Sep 08 16:16:34.187507 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 55/109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:33 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:34.187734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:34.192390 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:34.613513 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:34.631275 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:34.635457 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:34.637980 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-591b6b39-43e8-4803-beb5-6dfb00f20308 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.487690 Sep 08 16:16:34.639928 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 55/110] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:34 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:35.186486 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:35.191960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:35.217886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:35.218723 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:35.220127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:35.220954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:35.228967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:35.230553 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:35.265567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:35.268729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:35.271702 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:35.275852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:36.090241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:36.133939 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-694d7338-3b42-48b7-8fcb-34804f179d24 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1517 microversion: 2.1 time: 0.946418 Sep 08 16:16:36.137203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 56/111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:35 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1517 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:36.145134 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:36.146487 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:36.182274 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:36.183428 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:36.185124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:36.186087 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:36.187195 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:36.207794 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-00ff6a9b-7280-4e87-92f2-1da4918677dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 1.004325 Sep 08 16:16:36.210150 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 56/112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:35 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:36.220359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-362932d0-255c-4873-8ac8-6115435dc1e1 req-6b282e34-68b6-4c37-89b8-e7a177019c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db24e43-208d-4d9e-a75c-98f3168ab156", "name": "network-vif-plugged", "status": "completed", "tag": "ada104b9-d491-45ae-a144-07da180661e5"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:36.223594 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:36.223594 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:36.245763 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-362932d0-255c-4873-8ac8-6115435dc1e1 req-6b282e34-68b6-4c37-89b8-e7a177019c9b service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:36.248067 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-362932d0-255c-4873-8ac8-6115435dc1e1 req-6b282e34-68b6-4c37-89b8-e7a177019c9b service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:36.313257 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-362932d0-255c-4873-8ac8-6115435dc1e1 req-6b282e34-68b6-4c37-89b8-e7a177019c9b service nova] Creating event network-vif-plugged:ada104b9-d491-45ae-a144-07da180661e5 for instance 3db24e43-208d-4d9e-a75c-98f3168ab156 on hv-cinder-80789 Sep 08 16:16:36.335987 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-362932d0-255c-4873-8ac8-6115435dc1e1 req-6b282e34-68b6-4c37-89b8-e7a177019c9b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123308 Sep 08 16:16:36.343613 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 57/113] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:36.369496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:36.374464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:36.403965 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:36.404759 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:36.406111 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:36.407926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:36.667060 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lazy-loading 'flavor' on Instance uuid ccdab9af-f621-453f-9905-a59a53ee671c {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:16:36.786219 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:36.814894 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:36.818117 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:36.820251 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-492f329a-43d6-447e-bc96-0aad29045b03 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.681262 Sep 08 16:16:36.821384 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 57/114] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:36 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:36.982557 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2745a722-5e7d-4ead-8a41-947e0faf2457 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c/action" status: 200 len: 32 microversion: 2.1 time: 0.635882 Sep 08 16:16:37.002194 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:37.003220 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 58/115] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:36 2021] POST /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c/action => generated 32 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:16:37.005416 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:37.040103 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:37.040875 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:37.042344 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:37.043129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:37.253658 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:37.258742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:37.302018 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:37.302628 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:37.303653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:37.304437 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:38.088235 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:38.112798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b8f51dfc-eb10-4486-8619-b79483817dd4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 1.119726 Sep 08 16:16:38.114227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 58/116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:36 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:38.123990 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:38.125543 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:38.142778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:38.143904 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:38.145689 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:38.146742 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:38.286852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:38.305439 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3f19154f-f0d6-4ff1-a83c-4a16f6920e55 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1363 microversion: 2.1 time: 1.066923 Sep 08 16:16:38.307038 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 59/117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:37 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1363 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:38.344762 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1916972962", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "204b86ab-9a41-430c-b098-cab74514186e"}]}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:38.554532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] validate_networks() for [('204b86ab-9a41-430c-b098-cab74514186e', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:16:38.743049 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:38.779567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:38.783354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:38.788592 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-993100c1-a5ab-4c40-a3b0-6492229beb8c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.669420 Sep 08 16:16:38.791343 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 59/118] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:38 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:39.147711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:39.149992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:39.169446 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:39.171554 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:39.174333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:39.175609 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:39.814471 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:39.831449 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2f54f255-115c-4ab0-b94a-66ce04acd47c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.691674 Sep 08 16:16:39.833437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 60/119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:39 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:39.842537 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:39.843969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:39.864866 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:39.865692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:39.867100 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:39.868087 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:39.877632 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:16:39.878446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:16:39.878761 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:16:39.879278 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:16:39.879845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:16:39.890582 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:39.891187 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:39.892392 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:39.892903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:39.918861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:16:39.924284 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for user 7beb1f9356b8445ebaaf7a422a8aad6b and project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:16:39.937729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:16:39.940511 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:16:40.059280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f3247da9-028a-474a-8029-0797490adb5f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750069 Sep 08 16:16:40.060447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 60/120] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:16:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:16:40.071666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:40.073059 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:40.090667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:40.091646 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:40.093537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:40.095258 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:40.236769 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.263017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-49f98e82-5a44-4bc4-b406-9c3913e6af7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1549 microversion: 2.1 time: 0.427365 Sep 08 16:16:40.284289 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 61/121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:39 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1549 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:40.298192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c3d58dfd-3a7f-492b-a2c2-be1e0358d51a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:40.299432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c3d58dfd-3a7f-492b-a2c2-be1e0358d51a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:40.498499 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-c3d58dfd-3a7f-492b-a2c2-be1e0358d51a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.514375 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c3d58dfd-3a7f-492b-a2c2-be1e0358d51a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1218 microversion: 2.1 time: 0.227847 Sep 08 16:16:40.524182 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 62/122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:40 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:40.542714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e3f51cf4-ca17-4353-95e8-18867b1608dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:40.543521 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e3f51cf4-ca17-4353-95e8-18867b1608dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:40.559928 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e3f51cf4-ca17-4353-95e8-18867b1608dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:40.561105 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e3f51cf4-ca17-4353-95e8-18867b1608dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:40.563035 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e3f51cf4-ca17-4353-95e8-18867b1608dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:40.564485 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e3f51cf4-ca17-4353-95e8-18867b1608dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:40.705408 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.727957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.734292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.736447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-156994d2-0c21-4a83-9ea8-796f42acb4c1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.673793 Sep 08 16:16:40.738819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 61/123] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:40 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:40.851030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:40.852537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:40.866014 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e3f51cf4-ca17-4353-95e8-18867b1608dc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.326463 Sep 08 16:16:40.867768 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 63/124] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Sep 8 16:16:40 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-interface => generated 285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:40.877651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:40.878541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:40.881117 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:40.882134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:41.518055 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-6844e9f4-7327-4edf-adb5-e8f50869f514 req-0dae4b37-6dcb-4df1-9d54-578174d94203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dd36a3-a4b2-4d0e-8140-e629d0c9954d", "name": "network-vif-plugged", "status": "completed", "tag": "625c811b-4427-4c32-9c2e-61a56adb42db"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:41.531579 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:41.531579 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:16:41.578493 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-6844e9f4-7327-4edf-adb5-e8f50869f514 req-0dae4b37-6dcb-4df1-9d54-578174d94203 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:41.579298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-6844e9f4-7327-4edf-adb5-e8f50869f514 req-0dae4b37-6dcb-4df1-9d54-578174d94203 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:41.647970 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-6844e9f4-7327-4edf-adb5-e8f50869f514 req-0dae4b37-6dcb-4df1-9d54-578174d94203 service nova] Creating event network-vif-plugged:625c811b-4427-4c32-9c2e-61a56adb42db for instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d on hv-cinder-80789 Sep 08 16:16:41.691024 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-6844e9f4-7327-4edf-adb5-e8f50869f514 req-0dae4b37-6dcb-4df1-9d54-578174d94203 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183488 Sep 08 16:16:41.692013 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 64/125] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:41.709271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:41.710196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:41.721394 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:41.722297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:41.723373 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:41.724090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:42.069043 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:42.090845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c1371ea1-1885-4c3b-8d80-f8ae5b1486b9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1270 microversion: 2.1 time: 0.397239 Sep 08 16:16:42.098985 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:42.104536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 65/126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:41 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1270 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:42.110121 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:42.110731 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:42.120468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:42.120913 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:42.121696 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:42.122136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:42.129915 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f56d4c9b-3275-4cfe-877a-f9173a9319e1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 1.284419 Sep 08 16:16:42.132387 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 62/127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:40 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:43.116290 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:43.119295 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:43.158796 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:43.159908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:43.162259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:43.163949 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:43.191033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:43.209491 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:43.218759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:43.223837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6f221193-d479-43e8-906c-575398d41fc6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 1.118038 Sep 08 16:16:43.224716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 66/128] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:42 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:43.237208 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:43.238372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:43.257359 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:43.262115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:43.264313 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:43.265382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:43.833873 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:43.863461 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0d4415c2-a13d-4b3a-995d-918ef23cb21c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1278 microversion: 2.1 time: 0.755905 Sep 08 16:16:43.864532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 63/129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:43 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1278 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:44.257251 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:44.258942 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:44.270810 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:44.272813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:44.274626 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:44.277447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:44.288200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:44.303503 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-08bcc516-4132-47f9-acbc-9defe91fc2d8 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 1.074075 Sep 08 16:16:44.304479 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:43 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:44.857279 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:44.897711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:44.900478 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:44.902345 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:44.907014 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0ee85544-3017-476f-b46c-f0b20d2e50e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1405 microversion: 2.20 time: 0.653571 Sep 08 16:16:44.907773 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:44.911507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 64/131] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:44 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1405 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:16:44.980520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:44.981277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:44.988016 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:44.990019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:45.336744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:45.339820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:45.366120 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:45.367312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:45.370007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:45.371147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:45.749915 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:45.765227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-493cc142-7988-4351-8407-449b60b92a0c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.873466 Sep 08 16:16:45.767280 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 68/132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:44 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:45.793059 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c0d195b1-d261-409e-9b17-48aabcd67afd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:45.795434 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c0d195b1-d261-409e-9b17-48aabcd67afd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:45.825167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c0d195b1-d261-409e-9b17-48aabcd67afd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:45.825167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c0d195b1-d261-409e-9b17-48aabcd67afd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:45.825167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c0d195b1-d261-409e-9b17-48aabcd67afd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:45.825167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c0d195b1-d261-409e-9b17-48aabcd67afd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.094098 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:46.105138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-77381018-385d-42ab-9551-d3cd89b5f5bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.778148 Sep 08 16:16:46.117425 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 65/133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:45 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:46.130108 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-ca66b6ab-024a-4b89-9db1-112835f44f4a req-e6a9abfd-e960-4c3a-a136-367ab805094d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db24e43-208d-4d9e-a75c-98f3168ab156", "tag": "ada104b9-d491-45ae-a144-07da180661e5"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:46.131890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:46.131890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:46.157074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-ca66b6ab-024a-4b89-9db1-112835f44f4a req-e6a9abfd-e960-4c3a-a136-367ab805094d service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:46.158045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-ca66b6ab-024a-4b89-9db1-112835f44f4a req-e6a9abfd-e960-4c3a-a136-367ab805094d service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.208030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c0d195b1-d261-409e-9b17-48aabcd67afd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 14 microversion: 2.1 time: 0.426121 Sep 08 16:16:46.208303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-ca66b6ab-024a-4b89-9db1-112835f44f4a req-e6a9abfd-e960-4c3a-a136-367ab805094d service nova] Creating event network-changed:ada104b9-d491-45ae-a144-07da180661e5 for instance 3db24e43-208d-4d9e-a75c-98f3168ab156 on hv-cinder-80789 Sep 08 16:16:46.209411 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 69/134] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:45 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 14 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 16:16:46.215870 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:46.217143 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:46.221388 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-ca66b6ab-024a-4b89-9db1-112835f44f4a req-e6a9abfd-e960-4c3a-a136-367ab805094d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098614 Sep 08 16:16:46.223867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 66/135] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:46.239082 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:46.240562 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:46.241321 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:46.245004 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.246441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:46.247058 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.278111 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:46.278699 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.279554 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:46.283631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.328154 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:16:46.570186 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-eed8236f-09b9-4226-a7f7-a0e47e6268d3 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 204 len: 0 microversion: 2.1 time: 0.358366 Sep 08 16:16:46.570929 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 70/136] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:16:46 2021] DELETE /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:16:46.588290 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:46.588290 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:46.601964 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:46.602433 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.604065 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:46.604399 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:46.898138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:46.916311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:46.941527 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:46.948606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-69f65c6b-e0d7-4697-ba59-d06dc1524c7f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1598 microversion: 2.20 time: 0.719591 Sep 08 16:16:46.950698 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 67/137] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:16:46 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1598 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:16:46.973015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:46.973649 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:47.000707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.001159 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:47.014925 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.015524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:47.117801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:47.133724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f62ce4c8-2504-4306-80e3-387c82ad2afa tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1553 microversion: 2.1 time: 0.556115 Sep 08 16:16:47.145427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 71/138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:46 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1553 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:47.156991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0ba84806-afb1-44b8-9ec7-963f132205d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:47.157876 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0ba84806-afb1-44b8-9ec7-963f132205d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:47.177303 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ba84806-afb1-44b8-9ec7-963f132205d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.179307 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ba84806-afb1-44b8-9ec7-963f132205d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:47.183889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ba84806-afb1-44b8-9ec7-963f132205d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.184566 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ba84806-afb1-44b8-9ec7-963f132205d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:47.434170 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0ba84806-afb1-44b8-9ec7-963f132205d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.287370 Sep 08 16:16:47.434829 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 72/139] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Sep 8 16:16:47 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-interface => generated 285 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:16:47.448883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:47.449511 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:47.458954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.459457 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:47.460493 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.461132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:47.763714 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:47.786140 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-de84b002-5345-4a77-901b-777cb3539265 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.827015 Sep 08 16:16:47.787199 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 68/140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:46 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:47.792322 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-aa1e5d3e-17dc-4f20-a69a-5b6f8fb9267e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:47.793299 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-aa1e5d3e-17dc-4f20-a69a-5b6f8fb9267e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:47.825888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa1e5d3e-17dc-4f20-a69a-5b6f8fb9267e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.826347 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa1e5d3e-17dc-4f20-a69a-5b6f8fb9267e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:47.827148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa1e5d3e-17dc-4f20-a69a-5b6f8fb9267e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:47.827621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa1e5d3e-17dc-4f20-a69a-5b6f8fb9267e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:48.117742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-aa1e5d3e-17dc-4f20-a69a-5b6f8fb9267e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 14 microversion: 2.1 time: 0.328803 Sep 08 16:16:48.119633 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 69/141] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:47 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 14 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:16:48.126424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-2a714219-31fc-45d0-9b55-9175c1e2def6 req-aa6b6ac5-c3d9-45ed-b524-3c1a55440f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e52b75-f414-4602-9e4a-b937e7875135", "tag": "aa473e45-2d44-4f49-a4fd-95423bbd6c8d"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:48.129105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:48.129105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:48.148828 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-2a714219-31fc-45d0-9b55-9175c1e2def6 req-aa6b6ac5-c3d9-45ed-b524-3c1a55440f14 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:48.150442 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-2a714219-31fc-45d0-9b55-9175c1e2def6 req-aa6b6ac5-c3d9-45ed-b524-3c1a55440f14 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:48.173362 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-2a714219-31fc-45d0-9b55-9175c1e2def6 req-aa6b6ac5-c3d9-45ed-b524-3c1a55440f14 service nova] Creating event network-changed:aa473e45-2d44-4f49-a4fd-95423bbd6c8d for instance 97e52b75-f414-4602-9e4a-b937e7875135 on hv-cinder-80789 Sep 08 16:16:48.179626 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-2a714219-31fc-45d0-9b55-9175c1e2def6 req-aa6b6ac5-c3d9-45ed-b524-3c1a55440f14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057818 Sep 08 16:16:48.180883 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 70/142] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:48.188446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:48.189346 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:48.199259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:48.200003 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:48.213034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:48.214373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:48.644810 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:48.660849 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fd250038-4ee4-42c1-95e9-75171419a57d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 1.224506 Sep 08 16:16:48.662299 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 73/143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:47 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:48.811368 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:48.812623 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:48.823943 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:48.824732 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:48.825846 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:48.826523 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:49.297589 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:49.308496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ab91abf5-4f9c-4960-9114-2edbd4a3073c tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1553 microversion: 2.1 time: 1.125206 Sep 08 16:16:49.309026 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 71/144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:48 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1553 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:49.328308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-cf01fb92-44b7-4f9f-8fcd-405ed88290cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:49.329320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-cf01fb92-44b7-4f9f-8fcd-405ed88290cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:49.355595 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf01fb92-44b7-4f9f-8fcd-405ed88290cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:49.356338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf01fb92-44b7-4f9f-8fcd-405ed88290cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:49.357045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf01fb92-44b7-4f9f-8fcd-405ed88290cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:49.357576 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf01fb92-44b7-4f9f-8fcd-405ed88290cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:49.479780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:49.491914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-da559fe6-a149-423d-93e3-5c6c8eb510fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.687119 Sep 08 16:16:49.495822 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 74/145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:48 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:49.661633 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-cf01fb92-44b7-4f9f-8fcd-405ed88290cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 14 microversion: 2.1 time: 0.336980 Sep 08 16:16:49.668675 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 72/146] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:49 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 14 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:16:49.679619 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:49.679984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:49.697459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:49.699380 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:49.701241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:49.702361 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:50.337091 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:50.340203 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:50.342174 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:50.357583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:50.358876 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:50.373096 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fb1cebd7-2a47-40c8-8984-c60959cda70f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.697678 Sep 08 16:16:50.387536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 75/147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:49 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:50.395347 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:50.398318 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:50.522840 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:50.527096 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:50.551397 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:50.557667 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:50.562888 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:50.563452 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:51.780938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:51.797926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:51.800332 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2f58f658-5441-4aba-be31-33cf399de61f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 1.290278 Sep 08 16:16:51.813546 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dba729fe-4be8-494f-902c-71fc1f1dc56f tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1553 microversion: 2.1 time: 1.483800 Sep 08 16:16:51.814712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 73/149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:50 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1553 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:51.818945 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 76/149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:50 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:51.823995 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d454adac-6011-4e3c-96a3-4a28178d718f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:51.825902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d454adac-6011-4e3c-96a3-4a28178d718f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:51.829634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:51.831297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:51.846179 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:51.849267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d454adac-6011-4e3c-96a3-4a28178d718f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:51.850490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d454adac-6011-4e3c-96a3-4a28178d718f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:51.855315 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d454adac-6011-4e3c-96a3-4a28178d718f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:51.856822 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d454adac-6011-4e3c-96a3-4a28178d718f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:51.867279 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:51.869663 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:51.870914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:52.140471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d454adac-6011-4e3c-96a3-4a28178d718f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 14 microversion: 2.1 time: 0.322740 Sep 08 16:16:52.145552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 74/150] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:51 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 14 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:16:52.159244 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fe348453-ac20-4ab7-88c6-e8830fcdbf0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:52.167595 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fe348453-ac20-4ab7-88c6-e8830fcdbf0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:52.185298 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe348453-ac20-4ab7-88c6-e8830fcdbf0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:52.186133 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe348453-ac20-4ab7-88c6-e8830fcdbf0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:52.187846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe348453-ac20-4ab7-88c6-e8830fcdbf0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:52.188651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe348453-ac20-4ab7-88c6-e8830fcdbf0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:52.391188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fe348453-ac20-4ab7-88c6-e8830fcdbf0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 14 microversion: 2.20 time: 0.246961 Sep 08 16:16:52.392729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 75/151] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:16:52 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:52.404515 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-d3821666-7a0a-4a2d-8b65-6d054b312be5 req-fa406a88-055e-4d17-a32d-52a15ed2d3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dd36a3-a4b2-4d0e-8140-e629d0c9954d", "tag": "625c811b-4427-4c32-9c2e-61a56adb42db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:52.408026 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:52.408026 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:52.427358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d3821666-7a0a-4a2d-8b65-6d054b312be5 req-fa406a88-055e-4d17-a32d-52a15ed2d3d9 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:52.428228 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d3821666-7a0a-4a2d-8b65-6d054b312be5 req-fa406a88-055e-4d17-a32d-52a15ed2d3d9 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:52.473973 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-d3821666-7a0a-4a2d-8b65-6d054b312be5 req-fa406a88-055e-4d17-a32d-52a15ed2d3d9 service nova] Creating event network-changed:625c811b-4427-4c32-9c2e-61a56adb42db for instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d on hv-cinder-80789 Sep 08 16:16:52.495867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-d3821666-7a0a-4a2d-8b65-6d054b312be5 req-fa406a88-055e-4d17-a32d-52a15ed2d3d9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100541 Sep 08 16:16:52.510731 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 76/152] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:52.550292 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:52.574654 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e7900aba-b33b-47b5-baaf-8c337b6ec6b9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.753112 Sep 08 16:16:52.576724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 77/153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:51 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:52.831452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:52.833682 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:52.845007 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:52.848708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:52.849329 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:52.849948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:52.851562 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:52.852494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:52.960679 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:52.967540 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:52.971505 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:52.978659 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:53.418791 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:53.463358 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-52cc360c-f1d0-40ae-af7c-8010672aa1be tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1511 microversion: 2.1 time: 0.619138 Sep 08 16:16:53.464615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 78/154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:52 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1511 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:53.488810 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4d14e3ad-2232-49c4-8e40-accbe7c94de0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:53.490648 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4d14e3ad-2232-49c4-8e40-accbe7c94de0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:53.523185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4d14e3ad-2232-49c4-8e40-accbe7c94de0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:53.524051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4d14e3ad-2232-49c4-8e40-accbe7c94de0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:53.531001 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4d14e3ad-2232-49c4-8e40-accbe7c94de0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:53.531976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4d14e3ad-2232-49c4-8e40-accbe7c94de0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:53.560216 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:53.585906 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-81d10e16-88d3-430e-9494-e7d5b871061a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.760285 Sep 08 16:16:53.590521 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 77/155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:52 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:53.609950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9fbadc1b-6e47-4b85-a4f8-c52251e61756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:53.614250 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9fbadc1b-6e47-4b85-a4f8-c52251e61756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:53.645979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbadc1b-6e47-4b85-a4f8-c52251e61756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:53.647267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbadc1b-6e47-4b85-a4f8-c52251e61756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:53.653748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbadc1b-6e47-4b85-a4f8-c52251e61756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:53.655964 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbadc1b-6e47-4b85-a4f8-c52251e61756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:53.904608 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9fbadc1b-6e47-4b85-a4f8-c52251e61756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 14 microversion: 2.20 time: 0.310345 Sep 08 16:16:53.907910 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 78/156] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:16:53 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:53.919689 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-83e9bd0e-8aa6-4306-8701-6f492ae40267 req-6c81b13c-1049-4161-ad91-7c0c75ca0efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b195b8-bfe8-41df-869b-6898cf9164ec", "name": "network-vif-deleted", "tag": "9bbcf2be-3721-436a-98a5-308ffff99b29"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:53.921852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:53.921852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:53.939208 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4d14e3ad-2232-49c4-8e40-accbe7c94de0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 14 microversion: 2.1 time: 0.471971 Sep 08 16:16:53.942600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 79/157] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:53 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 14 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:16:53.966794 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-83e9bd0e-8aa6-4306-8701-6f492ae40267 req-6c81b13c-1049-4161-ad91-7c0c75ca0efd service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:53.967253 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-83e9bd0e-8aa6-4306-8701-6f492ae40267 req-6c81b13c-1049-4161-ad91-7c0c75ca0efd service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:53.990262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:53.992469 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:54.013809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-83e9bd0e-8aa6-4306-8701-6f492ae40267 req-6c81b13c-1049-4161-ad91-7c0c75ca0efd service nova] Creating event network-vif-deleted:9bbcf2be-3721-436a-98a5-308ffff99b29 for instance c9b195b8-bfe8-41df-869b-6898cf9164ec on hv-cinder-80789 Sep 08 16:16:54.022041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-83e9bd0e-8aa6-4306-8701-6f492ae40267 req-6c81b13c-1049-4161-ad91-7c0c75ca0efd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110191 Sep 08 16:16:54.025647 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 79/158] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:54.047494 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:54.048463 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:54.053764 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:54.054555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:54.507539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:54.507539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:54.531120 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:54.531641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:54.532494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:54.534027 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:54.861413 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:54.898553 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2f258075-4450-47e2-8dff-309aedae2e0f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.952765 Sep 08 16:16:54.900566 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 80/159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:53 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:54.912825 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:54.915617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:54.924288 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:54.925110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:54.926158 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:54.926831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:55.105257 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89479db82b2c458e87504bd4ea2f1676', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb538f430ca94bd7b35bbf827cacf743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:55.124401 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-79882b6f-63a3-4650-b9f7-e19d4443b601 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 200 len: 1344 microversion: 2.1 time: 0.631504 Sep 08 16:16:55.126552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 80/160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:54 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 1344 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:55.148358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6919b9a2-462c-4715-9e7c-9593e366250b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:55.151452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6919b9a2-462c-4715-9e7c-9593e366250b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:55.171943 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6919b9a2-462c-4715-9e7c-9593e366250b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:55.174716 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6919b9a2-462c-4715-9e7c-9593e366250b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:55.176242 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6919b9a2-462c-4715-9e7c-9593e366250b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:55.177334 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6919b9a2-462c-4715-9e7c-9593e366250b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:55.323284 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:55.348905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1f555d11-1d20-45c8-8d81-ea4e01cebac9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.446564 Sep 08 16:16:55.349921 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 81/161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:54 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:55.375091 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5bcd4892-8f05-4aff-88e4-405447d419d0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:55.403633 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5bcd4892-8f05-4aff-88e4-405447d419d0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:55.417028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6919b9a2-462c-4715-9e7c-9593e366250b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 14 microversion: 2.20 time: 0.287233 Sep 08 16:16:55.417856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 81/162] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:16:55 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 14 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:55.421155 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5bcd4892-8f05-4aff-88e4-405447d419d0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:55.421863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5bcd4892-8f05-4aff-88e4-405447d419d0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:55.422923 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5bcd4892-8f05-4aff-88e4-405447d419d0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:55.423426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5bcd4892-8f05-4aff-88e4-405447d419d0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:55.617358 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5bcd4892-8f05-4aff-88e4-405447d419d0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 14 microversion: 2.1 time: 0.264426 Sep 08 16:16:55.625108 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 82/163] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:55 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 14 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:16:55.927260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:55.928572 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:55.972311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:55.973561 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:55.981460 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:55.982712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.147589 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:56.149289 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:56.163004 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.163852 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.165489 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.166454 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.221921 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] HTTP exception thrown: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. Sep 08 16:16:56.222886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Returning 404 to user: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:16:56.226232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a92d002d-65b2-4bbc-b8f4-5f3eb4ba4db6 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 404 len: 111 microversion: 2.1 time: 0.084215 Sep 08 16:16:56.226232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:56 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:16:56.366897 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:56.367885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:56.376781 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.377398 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.378314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.379197 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.422811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:56.445917 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4a511263-dc0f-4d5d-9755-d3a8a99ad0f7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.525940 Sep 08 16:16:56.448164 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 82/165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:55 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:56.457866 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9d46e89c-918b-4111-8d07-cecedc178401 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:56.459924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9d46e89c-918b-4111-8d07-cecedc178401 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:56.477106 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9d46e89c-918b-4111-8d07-cecedc178401 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.478121 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9d46e89c-918b-4111-8d07-cecedc178401 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.479851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9d46e89c-918b-4111-8d07-cecedc178401 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.480782 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9d46e89c-918b-4111-8d07-cecedc178401 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.683034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:56.692302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0f68f0a5-a148-419f-ab0e-2d4199f0e786 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.329229 Sep 08 16:16:56.694045 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 84/166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:56 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:56.695729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9d46e89c-918b-4111-8d07-cecedc178401 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 14 microversion: 2.20 time: 0.245480 Sep 08 16:16:56.697530 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 83/167] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:16:56 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 14 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:56.701234 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:56.702363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:56.707515 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e8e0a3cf-4d0f-480a-8396-f80d05e7062a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:56.708736 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e8e0a3cf-4d0f-480a-8396-f80d05e7062a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:56.710857 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.711502 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.712838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.713584 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.725707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8e0a3cf-4d0f-480a-8396-f80d05e7062a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.729241 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8e0a3cf-4d0f-480a-8396-f80d05e7062a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.730098 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8e0a3cf-4d0f-480a-8396-f80d05e7062a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:56.730538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8e0a3cf-4d0f-480a-8396-f80d05e7062a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:56.773922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] HTTP exception thrown: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. Sep 08 16:16:56.776071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Returning 404 to user: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:16:56.777489 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0fd6210a-b265-4f8c-96aa-28f7ff8e20b5 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.082300 Sep 08 16:16:56.778570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 85/168] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:16:56 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec/os-volume_attachments => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:16:56.970547 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e8e0a3cf-4d0f-480a-8396-f80d05e7062a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 14 microversion: 2.1 time: 0.270929 Sep 08 16:16:56.972667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 84/169] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:56 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 14 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:16:57.465702 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:57.466481 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:57.476389 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:57.477171 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:57.479561 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:57.480212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:57.567817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-a57d29ea-fd30-41b8-bde2-e2f514fe269a req-66da5b57-8827-4d0f-b159-67d0755d9081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e52b75-f414-4602-9e4a-b937e7875135", "name": "network-vif-plugged", "status": "completed", "tag": "aa473e45-2d44-4f49-a4fd-95423bbd6c8d"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:57.572374 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:16:57.572374 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:16:57.593450 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-a57d29ea-fd30-41b8-bde2-e2f514fe269a req-66da5b57-8827-4d0f-b159-67d0755d9081 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:57.594576 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-a57d29ea-fd30-41b8-bde2-e2f514fe269a req-66da5b57-8827-4d0f-b159-67d0755d9081 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:57.627292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-a57d29ea-fd30-41b8-bde2-e2f514fe269a req-66da5b57-8827-4d0f-b159-67d0755d9081 service nova] Creating event network-vif-plugged:aa473e45-2d44-4f49-a4fd-95423bbd6c8d for instance 97e52b75-f414-4602-9e4a-b937e7875135 on hv-cinder-80789 Sep 08 16:16:57.640880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-a57d29ea-fd30-41b8-bde2-e2f514fe269a req-66da5b57-8827-4d0f-b159-67d0755d9081 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080524 Sep 08 16:16:57.642859 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 85/170] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:16:57.720427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:57.722570 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:57.739993 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:57.740756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:57.742093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:57.743067 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.054128 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:58.069696 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e205659e-01a0-432a-b35e-f891834c033d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.608632 Sep 08 16:16:58.071574 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 86/171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:57 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:58.083412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-69c075db-80fb-465b-a805-ca06b5df0942 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:58.084690 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-69c075db-80fb-465b-a805-ca06b5df0942 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:58.106509 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-69c075db-80fb-465b-a805-ca06b5df0942 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.108962 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-69c075db-80fb-465b-a805-ca06b5df0942 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.110134 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-69c075db-80fb-465b-a805-ca06b5df0942 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.110984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-69c075db-80fb-465b-a805-ca06b5df0942 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.184042 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:58.206961 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a3657dde-cfb8-4e17-864f-e8d97fa8198e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.495568 Sep 08 16:16:58.209156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 86/172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:57 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:58.221025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e35e059d-20be-4aa4-91ef-99b0a1b054fa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:58.223587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e35e059d-20be-4aa4-91ef-99b0a1b054fa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:58.240522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e35e059d-20be-4aa4-91ef-99b0a1b054fa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.245701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e35e059d-20be-4aa4-91ef-99b0a1b054fa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.250751 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e35e059d-20be-4aa4-91ef-99b0a1b054fa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.253956 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e35e059d-20be-4aa4-91ef-99b0a1b054fa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.346651 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-69c075db-80fb-465b-a805-ca06b5df0942 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 14 microversion: 2.20 time: 0.273533 Sep 08 16:16:58.348297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 87/173] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:16:58 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:58.380005 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:58.380602 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:58.400987 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.403965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.406723 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.407393 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.478830 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] HTTP exception thrown: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. Sep 08 16:16:58.480469 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Returning 404 to user: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:16:58.481783 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-152ea06f-c46d-4a10-873e-25f8f9296c87 tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 404 len: 111 microversion: 2.1 time: 0.110620 Sep 08 16:16:58.482876 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 88/174] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:16:58 2021] DELETE /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:16:58.493266 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:58.494123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] [instance: c9b195b8-bfe8-41df-869b-6898cf9164ec] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:58.502074 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.502617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.503852 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:58.504370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:58.562053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] HTTP exception thrown: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. Sep 08 16:16:58.562778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] Returning 404 to user: Instance c9b195b8-bfe8-41df-869b-6898cf9164ec could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:16:58.563722 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ee0d334c-0b8f-41f3-b8eb-35db086459bd tempest-DeleteServersTestJSON-1072958844 tempest-DeleteServersTestJSON-1072958844-project] 10.222.0.25 "GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec" status: 404 len: 111 microversion: 2.1 time: 0.074693 Sep 08 16:16:58.564607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 89/175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:58 2021] GET /compute/v2.1/servers/c9b195b8-bfe8-41df-869b-6898cf9164ec => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:16:58.876185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e35e059d-20be-4aa4-91ef-99b0a1b054fa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 5741 microversion: 2.1 time: 0.663976 Sep 08 16:16:58.877881 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 87/176] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:58 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 5741 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:59.102466 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:59.103895 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:59.120783 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.122129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:59.123882 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.125269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:59.240690 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:59.243943 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:59.279295 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.279763 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:59.284979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.292916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:59.637646 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:59.659367 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-52824997-5dc1-4fa0-9276-0e2eb3d57e1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.562572 Sep 08 16:16:59.660814 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 90/177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:59 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:59.667819 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-bcfa4cc6-1bc7-4b3b-a0a4-fcbfa79c4ab4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:59.668996 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-bcfa4cc6-1bc7-4b3b-a0a4-fcbfa79c4ab4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:59.677766 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcfa4cc6-1bc7-4b3b-a0a4-fcbfa79c4ab4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.678577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcfa4cc6-1bc7-4b3b-a0a4-fcbfa79c4ab4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:59.679664 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcfa4cc6-1bc7-4b3b-a0a4-fcbfa79c4ab4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.680348 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcfa4cc6-1bc7-4b3b-a0a4-fcbfa79c4ab4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:59.770396 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:59.779777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a860bc9d-aaa6-48df-9317-245508a4bada tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1318 microversion: 2.1 time: 0.546614 Sep 08 16:16:59.790600 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 88/178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:16:59 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:59.864568 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-bcfa4cc6-1bc7-4b3b-a0a4-fcbfa79c4ab4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 14 microversion: 2.20 time: 0.200276 Sep 08 16:16:59.865383 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 91/179] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:16:59 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:59.893095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1c3b9bc9-3a8a-4365-982a-f27d5dba34cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:59.895731 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1c3b9bc9-3a8a-4365-982a-f27d5dba34cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:16:59.930943 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c3b9bc9-3a8a-4365-982a-f27d5dba34cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.933440 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c3b9bc9-3a8a-4365-982a-f27d5dba34cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:16:59.944697 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c3b9bc9-3a8a-4365-982a-f27d5dba34cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:16:59.944697 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c3b9bc9-3a8a-4365-982a-f27d5dba34cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:00.139405 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1c3b9bc9-3a8a-4365-982a-f27d5dba34cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 11454 microversion: 2.1 time: 0.252990 Sep 08 16:17:00.145429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 89/180] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:16:59 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 11454 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:17:00.695350 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:00.698637 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:00.718772 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:00.719866 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:00.721232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:00.722212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:00.803388 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:00.804989 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:00.823317 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:00.825466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:00.827635 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:00.828729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:01.265267 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:01.274960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5dc6a986-97cc-45ce-806a-2a7203f56603 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.588109 Sep 08 16:17:01.276125 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 92/181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:00 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:01.281334 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a8fde361-b1f4-4f64-a7b6-6178363ec6ed tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:01.282703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a8fde361-b1f4-4f64-a7b6-6178363ec6ed tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:01.291757 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a8fde361-b1f4-4f64-a7b6-6178363ec6ed tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:01.292611 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a8fde361-b1f4-4f64-a7b6-6178363ec6ed tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:01.293706 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a8fde361-b1f4-4f64-a7b6-6178363ec6ed tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:01.294271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a8fde361-b1f4-4f64-a7b6-6178363ec6ed tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:01.345400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:01.370660 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5c305b7e-0a7c-4560-97ab-9d3f85760849 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1507 microversion: 2.1 time: 0.574858 Sep 08 16:17:01.372829 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 90/182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:00 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1507 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:01.385136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d5ba0264-23d2-4ebc-a53b-3fab22355468 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:01.387258 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d5ba0264-23d2-4ebc-a53b-3fab22355468 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:01.404636 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5ba0264-23d2-4ebc-a53b-3fab22355468 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:01.405522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5ba0264-23d2-4ebc-a53b-3fab22355468 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:01.406912 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5ba0264-23d2-4ebc-a53b-3fab22355468 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:01.408054 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5ba0264-23d2-4ebc-a53b-3fab22355468 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:01.731459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a8fde361-b1f4-4f64-a7b6-6178363ec6ed tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 14 microversion: 2.20 time: 0.452665 Sep 08 16:17:01.737662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 93/183] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:01 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 14 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:01.750024 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "253bedc9-06eb-486f-8e83-71cae3fac0a3"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:01.780792 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d5ba0264-23d2-4ebc-a53b-3fab22355468 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 16961 microversion: 2.1 time: 0.402491 Sep 08 16:17:01.783538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 91/184] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:01 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 16961 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:01.788230 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:01.816315 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:01.817367 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:01.818959 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:01.819949 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:02.296807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:02.297610 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:02.315300 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:02.315873 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:02.317252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:02.317777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:02.471917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] HTTP exception thrown: Invalid volume: volume 253bedc9-06eb-486f-8e83-71cae3fac0a3 is already attached to instances: 5667d820-d623-4b13-af5f-cee38599c046 Sep 08 16:17:02.472575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Returning 400 to user: Invalid volume: volume 253bedc9-06eb-486f-8e83-71cae3fac0a3 is already attached to instances: 5667d820-d623-4b13-af5f-cee38599c046 {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:17:02.474538 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-66336588-9f67-41fe-918c-59bd6b2ddde7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.735217 Sep 08 16:17:02.476611 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 94/185] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:17:01 2021] POST /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135/os-volume_attachments => generated 174 bytes in 738 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:17:02.746366 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-65ac32c8-1c06-4328-b12a-3981c7539da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:02.747512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-65ac32c8-1c06-4328-b12a-3981c7539da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:02.766352 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65ac32c8-1c06-4328-b12a-3981c7539da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:02.766811 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65ac32c8-1c06-4328-b12a-3981c7539da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:02.767905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65ac32c8-1c06-4328-b12a-3981c7539da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:02.768544 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65ac32c8-1c06-4328-b12a-3981c7539da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:02.777627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:02.821474 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6755a2db-8117-4e72-9c9b-d93aaa848df1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.532380 Sep 08 16:17:02.822982 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 92/186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:02 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:02.832635 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-258f8df0-12d5-46db-9387-7e87d3ca795a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:02.834718 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-258f8df0-12d5-46db-9387-7e87d3ca795a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:02.881686 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-258f8df0-12d5-46db-9387-7e87d3ca795a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:02.882574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-258f8df0-12d5-46db-9387-7e87d3ca795a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:02.884226 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-258f8df0-12d5-46db-9387-7e87d3ca795a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:02.886988 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-258f8df0-12d5-46db-9387-7e87d3ca795a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:05.554724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-65ac32c8-1c06-4328-b12a-3981c7539da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 15025 microversion: 2.20 time: 2.812480 Sep 08 16:17:05.560598 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 95/187] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:02 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 15025 bytes in 2816 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:05.563583 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:05.564596 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:05.578482 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-258f8df0-12d5-46db-9387-7e87d3ca795a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 22157 microversion: 2.1 time: 2.752775 Sep 08 16:17:05.584341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 93/188] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:02 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 22157 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:05.592237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:05.593537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:05.594521 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:05.595944 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:05.597188 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:05.597856 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:05.609667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:05.611222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:05.614214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:05.615349 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:05.905103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:05.916677 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-65d2a673-003e-4224-aa1b-4d782debcd3b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.335312 Sep 08 16:17:05.918204 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 94/189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:05 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:05.969157 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lazy-loading 'services' on Instance uuid 5667d820-d623-4b13-af5f-cee38599c046 {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:17:06.124826 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3534f8b7-248c-4e92-8501-11b619b99cab tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments/253bedc9-06eb-486f-8e83-71cae3fac0a3" status: 202 len: 0 microversion: 2.1 time: 0.565613 Sep 08 16:17:06.126024 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 96/190] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:17:05 2021] DELETE /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments/253bedc9-06eb-486f-8e83-71cae3fac0a3 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:06.135143 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d01d5f5c-1f4b-44ab-85b9-f6f6a7035c18 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:06.136248 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d01d5f5c-1f4b-44ab-85b9-f6f6a7035c18 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:06.144101 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d01d5f5c-1f4b-44ab-85b9-f6f6a7035c18 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:06.144521 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d01d5f5c-1f4b-44ab-85b9-f6f6a7035c18 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:06.145438 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d01d5f5c-1f4b-44ab-85b9-f6f6a7035c18 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:06.145740 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d01d5f5c-1f4b-44ab-85b9-f6f6a7035c18 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:06.244243 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d01d5f5c-1f4b-44ab-85b9-f6f6a7035c18 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113373 Sep 08 16:17:06.244840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 95/191] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:17:06 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:06.568933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5cf8ff82-3c5c-4915-9982-a74f20e00b08 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:06.570060 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5cf8ff82-3c5c-4915-9982-a74f20e00b08 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:06.581761 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5cf8ff82-3c5c-4915-9982-a74f20e00b08 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:06.582714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5cf8ff82-3c5c-4915-9982-a74f20e00b08 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:06.584053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5cf8ff82-3c5c-4915-9982-a74f20e00b08 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:06.584851 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5cf8ff82-3c5c-4915-9982-a74f20e00b08 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:06.593615 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-cf48535c-5442-4434-b1b9-c61ec38c4013 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:06.594614 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-cf48535c-5442-4434-b1b9-c61ec38c4013 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:06.604144 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf48535c-5442-4434-b1b9-c61ec38c4013 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:06.604589 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf48535c-5442-4434-b1b9-c61ec38c4013 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:06.605618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf48535c-5442-4434-b1b9-c61ec38c4013 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:06.606097 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf48535c-5442-4434-b1b9-c61ec38c4013 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:09.232039 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-cf48535c-5442-4434-b1b9-c61ec38c4013 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 24650 microversion: 2.1 time: 2.642398 Sep 08 16:17:09.234574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 96/192] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:06 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 24650 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:17:09.239114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:09.239856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:09.250430 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:09.251803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:09.253167 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:09.253889 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:09.298933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5cf8ff82-3c5c-4915-9982-a74f20e00b08 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 20997 microversion: 2.20 time: 2.734215 Sep 08 16:17:09.302820 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 97/193] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:06 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 20997 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:09.314376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0354f92d-2e0f-497b-b775-a819242767fd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:09.317021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0354f92d-2e0f-497b-b775-a819242767fd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:09.334466 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0354f92d-2e0f-497b-b775-a819242767fd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:09.335266 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0354f92d-2e0f-497b-b775-a819242767fd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:09.337120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0354f92d-2e0f-497b-b775-a819242767fd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:09.338410 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0354f92d-2e0f-497b-b775-a819242767fd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:09.481520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0354f92d-2e0f-497b-b775-a819242767fd tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176472 Sep 08 16:17:09.482330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 98/194] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:17:09 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:09.679416 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:09.696476 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8ceb2a33-27e8-40c0-8977-b47b8d82ed82 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.460710 Sep 08 16:17:09.697671 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 97/195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:09 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:10.246908 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6d3f3fd5-6453-4563-bb35-5557327e4d94 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:10.248191 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6d3f3fd5-6453-4563-bb35-5557327e4d94 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:10.258642 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d3f3fd5-6453-4563-bb35-5557327e4d94 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.259086 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d3f3fd5-6453-4563-bb35-5557327e4d94 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:10.260308 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d3f3fd5-6453-4563-bb35-5557327e4d94 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.260976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d3f3fd5-6453-4563-bb35-5557327e4d94 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:10.332056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-93ceb831-7ad6-4365-8da8-524388be5ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:10.333214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-93ceb831-7ad6-4365-8da8-524388be5ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:10.345625 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93ceb831-7ad6-4365-8da8-524388be5ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.346069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93ceb831-7ad6-4365-8da8-524388be5ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:10.346867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93ceb831-7ad6-4365-8da8-524388be5ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.347520 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93ceb831-7ad6-4365-8da8-524388be5ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:10.452462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6d3f3fd5-6453-4563-bb35-5557327e4d94 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 25200 microversion: 2.1 time: 0.210345 Sep 08 16:17:10.454059 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 99/196] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:10 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 25200 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:10.495886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9b063e08-42ea-45d1-b1d5-cabb3d2600d4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:10.497226 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9b063e08-42ea-45d1-b1d5-cabb3d2600d4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:10.505853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9b063e08-42ea-45d1-b1d5-cabb3d2600d4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.506303 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9b063e08-42ea-45d1-b1d5-cabb3d2600d4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:10.507231 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9b063e08-42ea-45d1-b1d5-cabb3d2600d4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.507774 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9b063e08-42ea-45d1-b1d5-cabb3d2600d4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:10.545819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-93ceb831-7ad6-4365-8da8-524388be5ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 22168 microversion: 2.20 time: 0.235306 Sep 08 16:17:10.546971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 98/197] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:10 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 22168 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:10.605427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9b063e08-42ea-45d1-b1d5-cabb3d2600d4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114231 Sep 08 16:17:10.606578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 100/198] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:17:10 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:10.729627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:10.730903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:10.747671 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.748881 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:10.750656 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:10.751898 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:11.475432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-48f67a98-ff71-4fae-893f-4e713204e59d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:11.484871 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-48f67a98-ff71-4fae-893f-4e713204e59d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:11.488888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:11.503224 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-48f67a98-ff71-4fae-893f-4e713204e59d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:11.503707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-48f67a98-ff71-4fae-893f-4e713204e59d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:11.508282 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-48f67a98-ff71-4fae-893f-4e713204e59d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:11.508735 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-48f67a98-ff71-4fae-893f-4e713204e59d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:11.508909 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-30ddfa71-d661-4b5a-9eff-d2b4fa1262d2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1523 microversion: 2.1 time: 0.787433 Sep 08 16:17:11.521108 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 99/199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:10 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1523 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:11.568482 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e8808ff5-dac4-478d-bdad-20037ec20bea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:11.573722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e8808ff5-dac4-478d-bdad-20037ec20bea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:11.604386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8808ff5-dac4-478d-bdad-20037ec20bea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:11.610984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8808ff5-dac4-478d-bdad-20037ec20bea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:11.615001 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8808ff5-dac4-478d-bdad-20037ec20bea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:11.620391 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8808ff5-dac4-478d-bdad-20037ec20bea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:11.738987 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-48f67a98-ff71-4fae-893f-4e713204e59d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 26013 microversion: 2.1 time: 0.273416 Sep 08 16:17:11.740184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 101/200] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:11 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 26013 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:11.750525 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-927fd68d-8c75-4e6d-bd09-7f252d018d9d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:11.751965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-927fd68d-8c75-4e6d-bd09-7f252d018d9d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:11.767622 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-927fd68d-8c75-4e6d-bd09-7f252d018d9d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:11.768785 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-927fd68d-8c75-4e6d-bd09-7f252d018d9d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:11.771763 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-927fd68d-8c75-4e6d-bd09-7f252d018d9d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:11.772561 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-927fd68d-8c75-4e6d-bd09-7f252d018d9d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:11.923573 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-927fd68d-8c75-4e6d-bd09-7f252d018d9d tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180700 Sep 08 16:17:11.924270 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e8808ff5-dac4-478d-bdad-20037ec20bea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 23169 microversion: 2.20 time: 0.363660 Sep 08 16:17:11.925568 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 102/201] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:17:11 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:11.942184 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 100/202] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:11 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 23169 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:12.541220 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:12.542293 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:12.585132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:12.587092 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:12.591803 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:12.592993 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:12.764772 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-94a634ac-317b-4652-b6ca-d86b65555adc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:12.771751 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-94a634ac-317b-4652-b6ca-d86b65555adc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:12.810820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-94a634ac-317b-4652-b6ca-d86b65555adc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:12.815317 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-94a634ac-317b-4652-b6ca-d86b65555adc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:12.817153 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-94a634ac-317b-4652-b6ca-d86b65555adc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:12.822872 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-94a634ac-317b-4652-b6ca-d86b65555adc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:13.574392 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:13.643030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f240ee24-01e3-471b-ba0b-0a10063bb2c3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1503 microversion: 2.1 time: 1.088940 Sep 08 16:17:13.648057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 103/203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:12 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1503 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:13.675053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0bb7a56a-818c-4100-adcc-e93dccd810d5 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:13.680283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0bb7a56a-818c-4100-adcc-e93dccd810d5 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:13.716709 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0bb7a56a-818c-4100-adcc-e93dccd810d5 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:13.720829 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0bb7a56a-818c-4100-adcc-e93dccd810d5 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:13.722721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0bb7a56a-818c-4100-adcc-e93dccd810d5 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:13.724024 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0bb7a56a-818c-4100-adcc-e93dccd810d5 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:13.896139 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0bb7a56a-818c-4100-adcc-e93dccd810d5 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.244218 Sep 08 16:17:13.901130 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 104/204] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:17:13 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046/os-volume_attachments => generated 25 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:17:13.907300 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3da9d321-f151-437f-85ef-05c1117f73e0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:13.908427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3da9d321-f151-437f-85ef-05c1117f73e0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:13.917857 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3da9d321-f151-437f-85ef-05c1117f73e0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:13.918576 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3da9d321-f151-437f-85ef-05c1117f73e0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:13.919634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3da9d321-f151-437f-85ef-05c1117f73e0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:13.920246 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3da9d321-f151-437f-85ef-05c1117f73e0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:16.134524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-94a634ac-317b-4652-b6ca-d86b65555adc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 27531 microversion: 2.1 time: 3.375931 Sep 08 16:17:16.136644 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 101/205] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:12 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 27531 bytes in 3387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:16.188132 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:16.191058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:16.215140 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3da9d321-f151-437f-85ef-05c1117f73e0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 25554 microversion: 2.20 time: 2.312489 Sep 08 16:17:16.216296 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 105/206] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:13 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 25554 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:16.222684 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1033257417", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "204b86ab-9a41-430c-b098-cab74514186e"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:16.225631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:16.226082 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:16.226954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:16.227393 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:16.412316 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] validate_networks() for [('204b86ab-9a41-430c-b098-cab74514186e', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:17:17.369068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:17.414789 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-bca5d190-cc57-4857-9d97-2f282f4ebe46 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1516 microversion: 2.1 time: 1.267884 Sep 08 16:17:17.416339 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 102/207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:16 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1516 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:17.451328 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-69f355ff-68f0-4671-b623-ee3b04c9a38d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:17.456482 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-69f355ff-68f0-4671-b623-ee3b04c9a38d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:17.479061 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f355ff-68f0-4671-b623-ee3b04c9a38d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:17.480592 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f355ff-68f0-4671-b623-ee3b04c9a38d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:17.482189 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f355ff-68f0-4671-b623-ee3b04c9a38d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:17.483615 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-69f355ff-68f0-4671-b623-ee3b04c9a38d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:17.871784 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-69f355ff-68f0-4671-b623-ee3b04c9a38d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 27891 microversion: 2.1 time: 0.452563 Sep 08 16:17:17.874219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 103/208] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:17 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 27891 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:17.901008 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-be846c40-f224-44a0-9af9-0a015bbed843 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:17.905743 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-be846c40-f224-44a0-9af9-0a015bbed843 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:17.946031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be846c40-f224-44a0-9af9-0a015bbed843 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:17.947289 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be846c40-f224-44a0-9af9-0a015bbed843 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:17.949454 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be846c40-f224-44a0-9af9-0a015bbed843 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:17.950723 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be846c40-f224-44a0-9af9-0a015bbed843 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:18.277951 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-be846c40-f224-44a0-9af9-0a015bbed843 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 26788 microversion: 2.20 time: 0.400790 Sep 08 16:17:18.280015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 104/209] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:17 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 26788 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:18.467595 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:17:18.468441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:17:18.469045 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:17:18.469946 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:17:18.470976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:17:18.505809 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:18.506655 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:18.508051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:18.508790 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:18.550029 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:17:18.556608 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for user 7beb1f9356b8445ebaaf7a422a8aad6b and project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:17:18.593036 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:17:18.598729 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:17:18.803656 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3cdf4033-575d-4433-9876-29cea9972d59 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.584315 Sep 08 16:17:18.804609 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 106/210] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:17:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:17:18.829256 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-eb2d8c0e-0606-4aa1-a69c-7466ed938e2a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:18.830512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-eb2d8c0e-0606-4aa1-a69c-7466ed938e2a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:18.899903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f24d7506-9db6-4e5a-8442-294f2828d1fd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:18.899903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f24d7506-9db6-4e5a-8442-294f2828d1fd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:18.956563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f24d7506-9db6-4e5a-8442-294f2828d1fd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:18.968694 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f24d7506-9db6-4e5a-8442-294f2828d1fd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:18.975614 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f24d7506-9db6-4e5a-8442-294f2828d1fd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:18.985468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f24d7506-9db6-4e5a-8442-294f2828d1fd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:19.264205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-eb2d8c0e-0606-4aa1-a69c-7466ed938e2a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:19.311695 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-eb2d8c0e-0606-4aa1-a69c-7466ed938e2a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1218 microversion: 2.1 time: 0.496568 Sep 08 16:17:19.322718 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 105/211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:18 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1218 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:19.355146 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4f8b8d14-cb86-4dcc-aa85-4002130001d6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:19.361234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4f8b8d14-cb86-4dcc-aa85-4002130001d6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:19.431704 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f8b8d14-cb86-4dcc-aa85-4002130001d6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:19.435355 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f8b8d14-cb86-4dcc-aa85-4002130001d6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:19.448603 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f8b8d14-cb86-4dcc-aa85-4002130001d6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:19.453332 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f8b8d14-cb86-4dcc-aa85-4002130001d6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:19.552592 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f24d7506-9db6-4e5a-8442-294f2828d1fd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28137 microversion: 2.1 time: 0.666729 Sep 08 16:17:19.554059 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 107/212] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:18 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28137 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:19.762252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4f8b8d14-cb86-4dcc-aa85-4002130001d6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 27486 microversion: 2.20 time: 0.435454 Sep 08 16:17:19.763890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 106/213] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:19 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 27486 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:20.353815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:20.355149 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:20.394330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:20.395610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:20.400040 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:20.402107 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:20.576552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7c5a895a-82aa-46bf-b9a7-f59d3f920de7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:20.583520 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7c5a895a-82aa-46bf-b9a7-f59d3f920de7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:20.682925 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c5a895a-82aa-46bf-b9a7-f59d3f920de7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:20.686126 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c5a895a-82aa-46bf-b9a7-f59d3f920de7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:20.689179 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c5a895a-82aa-46bf-b9a7-f59d3f920de7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:20.691619 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c5a895a-82aa-46bf-b9a7-f59d3f920de7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:20.891794 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:20.946017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d7432644-417b-48b4-82ec-ccfa27dd6919 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1214 microversion: 2.1 time: 0.604075 Sep 08 16:17:20.979606 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 108/214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:20 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1214 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:21.003612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-01bf52f9-5460-4c42-ba28-65371b1cd30d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:21.005119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-01bf52f9-5460-4c42-ba28-65371b1cd30d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:21.053309 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01bf52f9-5460-4c42-ba28-65371b1cd30d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:21.058848 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01bf52f9-5460-4c42-ba28-65371b1cd30d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:21.064194 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01bf52f9-5460-4c42-ba28-65371b1cd30d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:21.066023 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01bf52f9-5460-4c42-ba28-65371b1cd30d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:21.085936 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7c5a895a-82aa-46bf-b9a7-f59d3f920de7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28137 microversion: 2.1 time: 0.518164 Sep 08 16:17:21.093418 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 107/215] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:20 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28137 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:21.297105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:21.298397 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:21.309385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:21.309836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:21.310639 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:21.311079 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:21.404790 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-01bf52f9-5460-4c42-ba28-65371b1cd30d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 27786 microversion: 2.20 time: 0.423241 Sep 08 16:17:21.405445 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 109/216] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:20 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 27786 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:21.423991 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lazy-loading 'flavor' on Instance uuid 025be250-ed13-4171-af63-942ce76ab60a {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:17:21.665277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9deb8849-629a-4a50-af0a-dbb13220ad27 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action" status: 200 len: 32 microversion: 2.1 time: 0.370125 Sep 08 16:17:21.667169 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 108/217] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:21 2021] POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 16:17:21.684498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:21.686863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:21.716825 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:21.726347 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:21.728881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:21.739113 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:21.978113 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:21.979410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:22.002146 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:22.004076 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:22.006349 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:22.010205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:22.275306 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:22.308647 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a00bb9be-c44f-4ae7-b5c8-4dfb0cc14625 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.633721 Sep 08 16:17:22.314645 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 110/218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:21 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:22.338965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-05b51dbc-34a3-41d0-b629-e2cc5fe11c97 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:22.346069 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-05b51dbc-34a3-41d0-b629-e2cc5fe11c97 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:22.356083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:22.372242 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8a5bc2fd-5f29-4848-b0bb-32d62d36b716 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1276 microversion: 2.1 time: 0.400394 Sep 08 16:17:22.373237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 109/219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:21 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1276 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:22.379183 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05b51dbc-34a3-41d0-b629-e2cc5fe11c97 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:22.382196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05b51dbc-34a3-41d0-b629-e2cc5fe11c97 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:22.388369 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05b51dbc-34a3-41d0-b629-e2cc5fe11c97 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:22.389244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05b51dbc-34a3-41d0-b629-e2cc5fe11c97 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:22.421063 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a1d4e9bf-4be8-4dd0-9150-ab98fe51bb9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:22.422807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a1d4e9bf-4be8-4dd0-9150-ab98fe51bb9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:22.444565 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1d4e9bf-4be8-4dd0-9150-ab98fe51bb9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:22.445131 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1d4e9bf-4be8-4dd0-9150-ab98fe51bb9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:22.447340 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1d4e9bf-4be8-4dd0-9150-ab98fe51bb9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:22.447921 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1d4e9bf-4be8-4dd0-9150-ab98fe51bb9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:25.702897 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-05b51dbc-34a3-41d0-b629-e2cc5fe11c97 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28137 microversion: 2.1 time: 3.385747 Sep 08 16:17:25.703800 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 111/220] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:22 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28137 bytes in 3388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:25.723146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:25.741148 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:25.763291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a1d4e9bf-4be8-4dd0-9150-ab98fe51bb9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28084 microversion: 2.20 time: 3.346225 Sep 08 16:17:25.771754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 110/221] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:22 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28084 bytes in 3357 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:25.782414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:25.784019 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:25.788443 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:25.789401 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:25.791167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:25.798867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:25.799684 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:25.801150 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:25.801366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:25.801929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:26.227179 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:26.245916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f521c88e-cfaf-45b9-8ca6-6f84cc618870 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1276 microversion: 2.1 time: 0.471826 Sep 08 16:17:26.246511 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 111/222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:25 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1276 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:26.352384 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:26.365992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-56fea723-f044-4152-a1fa-06a48e4da08e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.660476 Sep 08 16:17:26.369939 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 112/223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:25 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:26.716896 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-64e4d1d8-db4d-4b4f-91a6-16491778c1be tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:26.718119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-64e4d1d8-db4d-4b4f-91a6-16491778c1be tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:26.738071 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-64e4d1d8-db4d-4b4f-91a6-16491778c1be tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:26.738851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-64e4d1d8-db4d-4b4f-91a6-16491778c1be tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:26.740965 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-64e4d1d8-db4d-4b4f-91a6-16491778c1be tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:26.743226 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-64e4d1d8-db4d-4b4f-91a6-16491778c1be tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:26.782639 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a0374802-758c-46dc-b72f-25f7a11d4c4b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:26.784287 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a0374802-758c-46dc-b72f-25f7a11d4c4b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:26.799293 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a0374802-758c-46dc-b72f-25f7a11d4c4b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:26.804880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a0374802-758c-46dc-b72f-25f7a11d4c4b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:26.806412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a0374802-758c-46dc-b72f-25f7a11d4c4b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:26.807450 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a0374802-758c-46dc-b72f-25f7a11d4c4b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:27.002207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-64e4d1d8-db4d-4b4f-91a6-16491778c1be tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28137 microversion: 2.1 time: 0.291270 Sep 08 16:17:27.007145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 112/224] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:26 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28137 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:27.116401 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a0374802-758c-46dc-b72f-25f7a11d4c4b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28199 microversion: 2.20 time: 0.337157 Sep 08 16:17:27.128499 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 113/225] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:26 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28199 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:27.264480 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:27.264895 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:27.283936 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:27.284391 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:27.285346 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:27.285657 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:27.404140 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:27.427554 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:27.482007 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:27.482757 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:27.484018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:27.484623 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:27.659722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:27.700965 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c4c4dede-8eea-43a6-acd7-2e6d500a8fa2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1276 microversion: 2.1 time: 0.441470 Sep 08 16:17:27.708662 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 113/226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:27 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1276 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:28.014746 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6d98970d-4c7c-4ea0-aaba-611dda7ea267 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:28.015809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6d98970d-4c7c-4ea0-aaba-611dda7ea267 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:28.024122 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6d98970d-4c7c-4ea0-aaba-611dda7ea267 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:28.024981 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6d98970d-4c7c-4ea0-aaba-611dda7ea267 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:28.026019 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6d98970d-4c7c-4ea0-aaba-611dda7ea267 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:28.026660 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6d98970d-4c7c-4ea0-aaba-611dda7ea267 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:28.126894 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:28.145686 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9da3a203-a02e-461d-814f-28e5392c39b1 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.758728 Sep 08 16:17:28.146436 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 114/227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:27 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:28.159794 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-44724956-a4af-4840-87ff-3b74f5e9b642 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:28.160722 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-44724956-a4af-4840-87ff-3b74f5e9b642 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:28.185795 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44724956-a4af-4840-87ff-3b74f5e9b642 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:28.187758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44724956-a4af-4840-87ff-3b74f5e9b642 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:28.188703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44724956-a4af-4840-87ff-3b74f5e9b642 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:28.189149 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44724956-a4af-4840-87ff-3b74f5e9b642 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:28.294967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6d98970d-4c7c-4ea0-aaba-611dda7ea267 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28428 microversion: 2.1 time: 0.283929 Sep 08 16:17:28.297197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 114/228] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:28 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28428 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:28.379103 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-44724956-a4af-4840-87ff-3b74f5e9b642 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28199 microversion: 2.20 time: 0.229439 Sep 08 16:17:28.382129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 115/229] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:28 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28199 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:28.741686 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:28.746732 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:28.768427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:28.769846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:28.771618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:28.772577 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:29.058629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:29.082931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c21afa09-7957-4961-8d4c-4da262d28164 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1276 microversion: 2.1 time: 0.359454 Sep 08 16:17:29.085108 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 115/230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:28 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1276 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:29.168695 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:29.170318 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:29.187067 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:29.188578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:29.190352 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:29.191413 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:29.321729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-34b40f73-ee43-48ce-8344-595447100f79 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:29.323550 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-34b40f73-ee43-48ce-8344-595447100f79 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:29.352311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-34b40f73-ee43-48ce-8344-595447100f79 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:29.352894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-34b40f73-ee43-48ce-8344-595447100f79 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:29.354472 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-34b40f73-ee43-48ce-8344-595447100f79 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:29.356655 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-34b40f73-ee43-48ce-8344-595447100f79 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:29.729409 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-34b40f73-ee43-48ce-8344-595447100f79 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28428 microversion: 2.1 time: 0.417892 Sep 08 16:17:29.730502 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 116/231] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:29 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28428 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:29.745701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0a261924-9f38-4096-a73b-395a09764b69 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:29.752314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:29.758550 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0a261924-9f38-4096-a73b-395a09764b69 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:29.781374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f10359b7-ac54-47ad-a525-d1e5373bad11 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.620063 Sep 08 16:17:29.782372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 116/232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:29 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:29.786680 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a261924-9f38-4096-a73b-395a09764b69 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:29.787141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a261924-9f38-4096-a73b-395a09764b69 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:29.788001 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a261924-9f38-4096-a73b-395a09764b69 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:29.788618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a261924-9f38-4096-a73b-395a09764b69 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:30.078150 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0a261924-9f38-4096-a73b-395a09764b69 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28490 microversion: 2.20 time: 0.343485 Sep 08 16:17:30.080112 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 117/233] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:29 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28490 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:30.109443 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:30.110386 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:30.123191 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:30.123860 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:30.124666 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:30.125106 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:30.264360 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:30.291887 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-bf9a87c0-8a93-4bb7-a04d-a5eab85eaeac tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1276 microversion: 2.1 time: 0.178968 Sep 08 16:17:30.291887 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 117/234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:30 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:30.749409 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-aa9805b8-aac3-4242-928c-12873ee36d81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:30.751244 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-aa9805b8-aac3-4242-928c-12873ee36d81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:30.768132 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa9805b8-aac3-4242-928c-12873ee36d81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:30.768908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa9805b8-aac3-4242-928c-12873ee36d81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:30.770715 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa9805b8-aac3-4242-928c-12873ee36d81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:30.771832 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa9805b8-aac3-4242-928c-12873ee36d81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:30.824624 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:30.829448 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:30.867711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:30.868748 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:30.871385 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:30.873926 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:31.028404 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-aa9805b8-aac3-4242-928c-12873ee36d81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28595 microversion: 2.1 time: 0.284330 Sep 08 16:17:31.030604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 118/235] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:30 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28595 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:31.103598 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ec33748d-44a7-4e60-ae69-c548fb21431f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:31.107975 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ec33748d-44a7-4e60-ae69-c548fb21431f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:31.164857 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec33748d-44a7-4e60-ae69-c548fb21431f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:31.169122 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec33748d-44a7-4e60-ae69-c548fb21431f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:31.175778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec33748d-44a7-4e60-ae69-c548fb21431f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:31.177028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec33748d-44a7-4e60-ae69-c548fb21431f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:31.510531 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ec33748d-44a7-4e60-ae69-c548fb21431f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28490 microversion: 2.20 time: 0.420763 Sep 08 16:17:31.514592 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 119/236] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:31 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28490 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:31.520851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:31.521498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:31.541551 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:31.542003 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:31.547895 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:31.548468 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:32.656311 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:32.702453 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-83ffbbb8-0983-4239-9565-ef73268bcad6 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 1.873750 Sep 08 16:17:32.715517 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 118/237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:30 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:32.716595 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-41f70dcb-e7ef-4747-b24d-910553b95f39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:32.726190 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-41f70dcb-e7ef-4747-b24d-910553b95f39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:32.748593 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41f70dcb-e7ef-4747-b24d-910553b95f39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:32.749433 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41f70dcb-e7ef-4747-b24d-910553b95f39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:32.750958 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41f70dcb-e7ef-4747-b24d-910553b95f39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:32.751768 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41f70dcb-e7ef-4747-b24d-910553b95f39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:33.018724 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:33.029843 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-41f70dcb-e7ef-4747-b24d-910553b95f39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28595 microversion: 2.1 time: 0.319690 Sep 08 16:17:33.031834 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 119/238] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:32 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28595 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:33.062502 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f8ac968e-3f96-4da1-91a2-b5fb3da7b541 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:33.064834 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f8ac968e-3f96-4da1-91a2-b5fb3da7b541 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:33.080067 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6645ae2b-5dc9-44d9-b887-55a6d290023a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 1.554506 Sep 08 16:17:33.089914 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 120/239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:31 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:33.103464 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f8ac968e-3f96-4da1-91a2-b5fb3da7b541 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:33.104621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f8ac968e-3f96-4da1-91a2-b5fb3da7b541 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:33.109183 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f8ac968e-3f96-4da1-91a2-b5fb3da7b541 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:33.110231 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f8ac968e-3f96-4da1-91a2-b5fb3da7b541 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:33.449756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-527cd6b9-c318-407d-9155-7a9d4f3a714e req-601da1c3-65de-4ed5-982f-65b856a77b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c08f6f9-7669-40ee-b76b-b418d405c6fd", "tag": "e918380a-f380-42f2-a078-3ebb80ee7526"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:33.450894 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f8ac968e-3f96-4da1-91a2-b5fb3da7b541 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28652 microversion: 2.20 time: 0.415663 Sep 08 16:17:33.452160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 120/240] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:33 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28652 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:33.466796 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:33.466796 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:17:33.511373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-527cd6b9-c318-407d-9155-7a9d4f3a714e req-601da1c3-65de-4ed5-982f-65b856a77b3a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:33.511373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-527cd6b9-c318-407d-9155-7a9d4f3a714e req-601da1c3-65de-4ed5-982f-65b856a77b3a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:33.533470 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-527cd6b9-c318-407d-9155-7a9d4f3a714e req-601da1c3-65de-4ed5-982f-65b856a77b3a service nova] Creating event network-changed:e918380a-f380-42f2-a078-3ebb80ee7526 for instance 8c08f6f9-7669-40ee-b76b-b418d405c6fd on hv-cinder-80789 Sep 08 16:17:33.540091 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-527cd6b9-c318-407d-9155-7a9d4f3a714e req-601da1c3-65de-4ed5-982f-65b856a77b3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097794 Sep 08 16:17:33.542056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 121/241] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:33.732897 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:33.734092 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:33.758265 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:33.758734 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:33.772553 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:33.772553 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:34.056937 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-73e359d0-f21d-4d64-b580-c309cc273a8f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:34.069585 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-73e359d0-f21d-4d64-b580-c309cc273a8f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:34.126014 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73e359d0-f21d-4d64-b580-c309cc273a8f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:34.130800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73e359d0-f21d-4d64-b580-c309cc273a8f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:34.133732 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73e359d0-f21d-4d64-b580-c309cc273a8f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:34.137479 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73e359d0-f21d-4d64-b580-c309cc273a8f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:34.393817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-73e359d0-f21d-4d64-b580-c309cc273a8f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28595 microversion: 2.1 time: 0.347128 Sep 08 16:17:34.394483 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 122/242] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:34 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28595 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:34.432990 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:34.435410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:34.474986 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:34.477530 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:34.479275 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:34.480493 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:34.634943 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:34.666047 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-263d2aef-390a-43d7-b505-0c383c5750d3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.937523 Sep 08 16:17:34.671704 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 121/243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:33 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:34.691969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eeb52938-dc82-4a78-af10-d3fa4ec18090 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:34.694764 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eeb52938-dc82-4a78-af10-d3fa4ec18090 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:34.722937 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eeb52938-dc82-4a78-af10-d3fa4ec18090 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:34.723753 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eeb52938-dc82-4a78-af10-d3fa4ec18090 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:34.735737 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eeb52938-dc82-4a78-af10-d3fa4ec18090 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:34.744924 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eeb52938-dc82-4a78-af10-d3fa4ec18090 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:35.138571 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-eeb52938-dc82-4a78-af10-d3fa4ec18090 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28652 microversion: 2.20 time: 0.462723 Sep 08 16:17:35.140863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 122/244] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:34 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28652 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:35.410406 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-39691ff2-71f5-4aef-9331-089a059a875b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:35.412016 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-39691ff2-71f5-4aef-9331-089a059a875b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:35.428252 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-39691ff2-71f5-4aef-9331-089a059a875b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:35.428676 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-39691ff2-71f5-4aef-9331-089a059a875b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:35.430577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-39691ff2-71f5-4aef-9331-089a059a875b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:35.432669 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-39691ff2-71f5-4aef-9331-089a059a875b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:35.450866 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:35.480925 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9c5393c0-90c2-4ad3-9e1b-06727b44484a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 1.078611 Sep 08 16:17:35.503527 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 123/245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:34 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:35.688398 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-39691ff2-71f5-4aef-9331-089a059a875b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28595 microversion: 2.1 time: 0.282231 Sep 08 16:17:35.696799 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 123/246] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:35 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28595 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:17:35.700936 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:35.701862 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:35.720723 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:35.721504 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:35.722928 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:35.723837 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:36.152215 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-412c609b-9d3f-4380-a78a-5a80af347b65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:36.153364 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-412c609b-9d3f-4380-a78a-5a80af347b65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:36.181137 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-412c609b-9d3f-4380-a78a-5a80af347b65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:36.181960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-412c609b-9d3f-4380-a78a-5a80af347b65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:36.182982 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-412c609b-9d3f-4380-a78a-5a80af347b65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:36.185340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-412c609b-9d3f-4380-a78a-5a80af347b65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:36.405825 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-412c609b-9d3f-4380-a78a-5a80af347b65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28652 microversion: 2.20 time: 0.257995 Sep 08 16:17:36.406749 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 124/247] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:36 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28652 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:36.512632 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:36.528352 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:36.538806 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:36.539428 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:36.540549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:36.540711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:37.217057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:37.234028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a625530c-482f-4a44-b7a8-d541d08e87ad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 1.540788 Sep 08 16:17:37.234599 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 124/248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:35 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:37.259800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3a58b76d-dae9-4d96-b6f8-b49322e89ef2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:37.267519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3a58b76d-dae9-4d96-b6f8-b49322e89ef2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:37.290930 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a58b76d-dae9-4d96-b6f8-b49322e89ef2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:37.291689 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a58b76d-dae9-4d96-b6f8-b49322e89ef2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:37.292486 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a58b76d-dae9-4d96-b6f8-b49322e89ef2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:37.302493 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a58b76d-dae9-4d96-b6f8-b49322e89ef2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:37.536374 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3a58b76d-dae9-4d96-b6f8-b49322e89ef2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 28759 microversion: 2.1 time: 0.299506 Sep 08 16:17:37.536863 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 125/249] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:37 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 28759 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:37.543052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2782d368-366b-4423-92f2-75ad70512ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:37.547447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2782d368-366b-4423-92f2-75ad70512ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:37.569366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2782d368-366b-4423-92f2-75ad70512ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:37.571426 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2782d368-366b-4423-92f2-75ad70512ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:37.572730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2782d368-366b-4423-92f2-75ad70512ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:37.584850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2782d368-366b-4423-92f2-75ad70512ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:37.791326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2782d368-366b-4423-92f2-75ad70512ba2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 28652 microversion: 2.20 time: 0.251403 Sep 08 16:17:37.793029 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 126/250] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:37 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 28652 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:37.901031 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:37.933709 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f97e962a-84dc-43cc-9af3-46219b540c5b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 1.425602 Sep 08 16:17:37.935811 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 125/251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:36 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:38.268103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:38.272002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:38.304724 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:38.306811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:38.308870 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:38.309492 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:38.553080 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a00443f4-4517-4e5d-99f9-97447f2ddc9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:38.554914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a00443f4-4517-4e5d-99f9-97447f2ddc9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:38.588154 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00443f4-4517-4e5d-99f9-97447f2ddc9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:38.589357 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00443f4-4517-4e5d-99f9-97447f2ddc9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:38.591865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00443f4-4517-4e5d-99f9-97447f2ddc9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:38.592577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a00443f4-4517-4e5d-99f9-97447f2ddc9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:38.762923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:38.833861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f9b4493f-8cc2-422d-964e-fde1f4f6bf5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.572859 Sep 08 16:17:38.838317 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 127/252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:38 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:38.862469 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8ab558f8-8ed7-47ee-a659-717ef78cbe6b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:38.864061 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8ab558f8-8ed7-47ee-a659-717ef78cbe6b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:38.908977 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ab558f8-8ed7-47ee-a659-717ef78cbe6b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:38.912451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ab558f8-8ed7-47ee-a659-717ef78cbe6b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:38.917290 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ab558f8-8ed7-47ee-a659-717ef78cbe6b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:38.918381 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ab558f8-8ed7-47ee-a659-717ef78cbe6b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:38.981976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a00443f4-4517-4e5d-99f9-97447f2ddc9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 30694 microversion: 2.1 time: 0.435513 Sep 08 16:17:38.984515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 126/253] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:38 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 30694 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:39.008933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:39.010512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:39.039081 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:39.050700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:39.052761 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:39.053752 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:39.285197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8ab558f8-8ed7-47ee-a659-717ef78cbe6b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 30121 microversion: 2.20 time: 0.444139 Sep 08 16:17:39.288099 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 128/254] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:38 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 30121 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:39.786649 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:39.811414 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f27b3aa6-3da0-4ae3-8583-f46a0b17b79c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 0.819867 Sep 08 16:17:39.816660 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 127/255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:38 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:39.893712 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:39.895421 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:39.913590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:39.915311 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:39.917178 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:39.918205 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:40.148543 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d917d210-1a8a-4020-ae20-a7af15a4cebe tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Action: 'create', calling method: .version_select at 0x7f37046ae3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1491269323"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:40.256074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-d917d210-1a8a-4020-ae20-a7af15a4cebe tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Getting quotas for project 0192ebea3f6246118edb985b970044bc. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:17:40.265519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-d917d210-1a8a-4020-ae20-a7af15a4cebe tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Getting quotas for user 253dd37a73cd4c5190fb30c9ac3885ee and project 0192ebea3f6246118edb985b970044bc. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:17:40.723293 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:40.757162 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-28a80992-67fe-47c6-bf80-bcb20f7e35bf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.883587 Sep 08 16:17:40.758569 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 128/256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:39 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:40.823618 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c81fcd9e-8a2e-49a5-a176-ab4e0237d454 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:40.834186 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c81fcd9e-8a2e-49a5-a176-ab4e0237d454 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:40.858207 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c81fcd9e-8a2e-49a5-a176-ab4e0237d454 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:40.858693 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c81fcd9e-8a2e-49a5-a176-ab4e0237d454 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:40.878228 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c81fcd9e-8a2e-49a5-a176-ab4e0237d454 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:40.886201 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c81fcd9e-8a2e-49a5-a176-ab4e0237d454 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:40.904800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-d917d210-1a8a-4020-ae20-a7af15a4cebe tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Getting quotas for project 0192ebea3f6246118edb985b970044bc. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:17:40.921737 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-d917d210-1a8a-4020-ae20-a7af15a4cebe tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Getting quotas for user 253dd37a73cd4c5190fb30c9ac3885ee and project 0192ebea3f6246118edb985b970044bc. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:17:40.956230 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d917d210-1a8a-4020-ae20-a7af15a4cebe tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.661891 Sep 08 16:17:40.956854 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 129/257] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Sep 8 16:17:39 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:40.964575 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9fbce2c5-4b83-41de-9178-bfb5a215f7eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:40.965642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9fbce2c5-4b83-41de-9178-bfb5a215f7eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:40.995216 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbce2c5-4b83-41de-9178-bfb5a215f7eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:40.995833 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbce2c5-4b83-41de-9178-bfb5a215f7eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:40.996683 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbce2c5-4b83-41de-9178-bfb5a215f7eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:40.997209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fbce2c5-4b83-41de-9178-bfb5a215f7eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:41.253210 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9fbce2c5-4b83-41de-9178-bfb5a215f7eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 32281 microversion: 2.20 time: 0.294786 Sep 08 16:17:41.254836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 130/258] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:40 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 32281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:41.262143 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:41.262948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:41.272456 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:41.272950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:41.273862 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:41.274444 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:41.286956 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c81fcd9e-8a2e-49a5-a176-ab4e0237d454 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 32938 microversion: 2.1 time: 0.500565 Sep 08 16:17:41.290605 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 129/259] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:40 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 32938 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:41.789412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:41.792156 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:41.808081 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:41.809049 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:41.809497 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:41.811212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:41.812327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:41.830988 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-08cab7cc-790e-4839-823c-53c8d97216fb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 0.574371 Sep 08 16:17:41.843803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 131/260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:41 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:42.273453 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fac9e677-586e-44b5-92fd-ff246156a0f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:42.277600 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fac9e677-586e-44b5-92fd-ff246156a0f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:42.295656 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac9e677-586e-44b5-92fd-ff246156a0f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:42.296574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac9e677-586e-44b5-92fd-ff246156a0f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:42.297135 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:42.299237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac9e677-586e-44b5-92fd-ff246156a0f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:42.300449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac9e677-586e-44b5-92fd-ff246156a0f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:42.326716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-01cd51e5-d426-4a69-a458-bd0c97466869 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.545405 Sep 08 16:17:42.331399 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 130/261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:41 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:42.353333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-aee178ba-fc41-44e2-8d3f-3981e85cdf9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:42.357412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-aee178ba-fc41-44e2-8d3f-3981e85cdf9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:42.383841 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aee178ba-fc41-44e2-8d3f-3981e85cdf9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:42.384896 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aee178ba-fc41-44e2-8d3f-3981e85cdf9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:42.386783 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aee178ba-fc41-44e2-8d3f-3981e85cdf9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:42.387755 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aee178ba-fc41-44e2-8d3f-3981e85cdf9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:42.670549 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fac9e677-586e-44b5-92fd-ff246156a0f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 33232 microversion: 2.20 time: 0.406147 Sep 08 16:17:42.681109 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 132/262] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:42 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 33232 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:42.742314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-aee178ba-fc41-44e2-8d3f-3981e85cdf9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 33485 microversion: 2.1 time: 0.408696 Sep 08 16:17:42.748910 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 131/263] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:42 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 33485 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:42.875169 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:42.886059 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:42.931034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:42.932823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:42.934608 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:42.937290 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:43.351309 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:43.363894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2bf7b483-8cd0-4586-9c07-6170d3facdeb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 0.497331 Sep 08 16:17:43.365467 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 133/264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:42 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:43.367519 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:43.368791 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:43.394518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:43.395309 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:43.398747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:43.400212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:43.687023 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8a6d4b73-0039-4a9c-ac69-9f48f3f79d3d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:43.688752 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8a6d4b73-0039-4a9c-ac69-9f48f3f79d3d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:43.711908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a6d4b73-0039-4a9c-ac69-9f48f3f79d3d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:43.712382 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a6d4b73-0039-4a9c-ac69-9f48f3f79d3d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:43.713192 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a6d4b73-0039-4a9c-ac69-9f48f3f79d3d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:43.713997 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a6d4b73-0039-4a9c-ac69-9f48f3f79d3d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:43.913046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:43.922020 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8a6d4b73-0039-4a9c-ac69-9f48f3f79d3d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 33776 microversion: 2.20 time: 0.238590 Sep 08 16:17:43.922738 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 134/265] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:43 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 33776 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:43.936442 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-51863fa7-e1ba-4a3f-8e51-c9889cef837d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:43.941430 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-51863fa7-e1ba-4a3f-8e51-c9889cef837d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:43.948454 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9bb70c6b-09bd-4de4-83cb-959408e6da9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.583597 Sep 08 16:17:43.955389 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 132/266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:43 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:43.982552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51863fa7-e1ba-4a3f-8e51-c9889cef837d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:43.983979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51863fa7-e1ba-4a3f-8e51-c9889cef837d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:43.984869 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51863fa7-e1ba-4a3f-8e51-c9889cef837d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:43.985308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51863fa7-e1ba-4a3f-8e51-c9889cef837d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:44.247587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-51863fa7-e1ba-4a3f-8e51-c9889cef837d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 34206 microversion: 2.1 time: 0.322695 Sep 08 16:17:44.248532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 135/267] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:43 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 34206 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:44.400752 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:44.404165 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:44.430020 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:44.432283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:44.433637 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:44.434566 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:44.791416 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-d0bf08c9-a754-4551-bb67-1a9a7825433f req-c5f1eb2e-7fe8-49e1-bf08-4c626f05f430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c08f6f9-7669-40ee-b76b-b418d405c6fd", "name": "network-vif-plugged", "status": "completed", "tag": "e918380a-f380-42f2-a078-3ebb80ee7526"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:44.813757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:17:44.813757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:17:44.850200 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d0bf08c9-a754-4551-bb67-1a9a7825433f req-c5f1eb2e-7fe8-49e1-bf08-4c626f05f430 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:44.851897 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d0bf08c9-a754-4551-bb67-1a9a7825433f req-c5f1eb2e-7fe8-49e1-bf08-4c626f05f430 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:44.894088 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-d0bf08c9-a754-4551-bb67-1a9a7825433f req-c5f1eb2e-7fe8-49e1-bf08-4c626f05f430 service nova] Creating event network-vif-plugged:e918380a-f380-42f2-a078-3ebb80ee7526 for instance 8c08f6f9-7669-40ee-b76b-b418d405c6fd on hv-cinder-80789 Sep 08 16:17:44.906955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-d0bf08c9-a754-4551-bb67-1a9a7825433f req-c5f1eb2e-7fe8-49e1-bf08-4c626f05f430 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123396 Sep 08 16:17:44.909048 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 136/268] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:17:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:44.956736 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-71cc2058-596c-4e1f-a408-27c355a407fc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:44.969678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-71cc2058-596c-4e1f-a408-27c355a407fc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:44.999709 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:45.020178 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ad9a4a72-d16f-4c2b-9806-2b69c499c596 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 0.624940 Sep 08 16:17:45.020449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71cc2058-596c-4e1f-a408-27c355a407fc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.021176 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71cc2058-596c-4e1f-a408-27c355a407fc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.021789 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 133/269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:44 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:45.027709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71cc2058-596c-4e1f-a408-27c355a407fc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.030735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71cc2058-596c-4e1f-a408-27c355a407fc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.041546 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:45.042431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:45.066001 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.068325 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.069373 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.072033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.356601 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-71cc2058-596c-4e1f-a408-27c355a407fc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 34573 microversion: 2.20 time: 0.422139 Sep 08 16:17:45.357636 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 137/270] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:44 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 34573 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:45.398893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fedd89e8-b3c2-417c-939f-7069752c8e06 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:45.402196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fedd89e8-b3c2-417c-939f-7069752c8e06 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:45.418892 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fedd89e8-b3c2-417c-939f-7069752c8e06 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.420068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fedd89e8-b3c2-417c-939f-7069752c8e06 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.421734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fedd89e8-b3c2-417c-939f-7069752c8e06 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.423377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fedd89e8-b3c2-417c-939f-7069752c8e06 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.759245 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fedd89e8-b3c2-417c-939f-7069752c8e06 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 35282 microversion: 2.1 time: 0.373775 Sep 08 16:17:45.761302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 138/271] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:45 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 35282 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:45.780844 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:45.807323 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-baa637f9-6c83-4f08-a66e-db9444e6f897 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1502 microversion: 2.1 time: 0.783835 Sep 08 16:17:45.808408 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:45 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1502 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:45.829083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a3051ae-414f-4b53-9547-eb4a65df434b"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:45.834226 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:45.852015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.852873 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.853855 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:45.854507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:45.966331 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] HTTP exception thrown: Cannot 'attach_volume' instance 025be250-ed13-4171-af63-942ce76ab60a while it is in vm_state rescued Sep 08 16:17:45.967358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Returning 409 to user: Cannot 'attach_volume' instance 025be250-ed13-4171-af63-942ce76ab60a while it is in vm_state rescued {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:17:45.968439 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5328d031-5a69-4f1b-b281-72270344038f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.145024 Sep 08 16:17:45.978534 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 139/273] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:17:45 2021] POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 152 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 16:17:45.986692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8d5cbfb6-0a06-4ec6-bc75-1bb37c5e491d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:45.988051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8d5cbfb6-0a06-4ec6-bc75-1bb37c5e491d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:46.015916 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8d5cbfb6-0a06-4ec6-bc75-1bb37c5e491d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.017017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8d5cbfb6-0a06-4ec6-bc75-1bb37c5e491d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.021197 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8d5cbfb6-0a06-4ec6-bc75-1bb37c5e491d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.022041 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8d5cbfb6-0a06-4ec6-bc75-1bb37c5e491d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.048189 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:46.049424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:46.075109 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.075971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.077184 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.078024 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.456068 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8d5cbfb6-0a06-4ec6-bc75-1bb37c5e491d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action" status: 202 len: 0 microversion: 2.1 time: 0.475635 Sep 08 16:17:46.460515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 135/274] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:45 2021] POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:46.482838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7ed569b4-26f8-48cf-b6e2-51acee5cd52f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:46.497575 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7ed569b4-26f8-48cf-b6e2-51acee5cd52f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:46.519339 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ed569b4-26f8-48cf-b6e2-51acee5cd52f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.522547 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ed569b4-26f8-48cf-b6e2-51acee5cd52f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.525765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ed569b4-26f8-48cf-b6e2-51acee5cd52f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.528761 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ed569b4-26f8-48cf-b6e2-51acee5cd52f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.713097 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:46.742934 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dd60403a-1d17-4724-98b9-5677dfa80a78 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1318 microversion: 2.1 time: 0.707040 Sep 08 16:17:46.745145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 140/275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:46 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:46.756230 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:46.759074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:46.776003 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.777057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.778541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.779236 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.841042 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7ed569b4-26f8-48cf-b6e2-51acee5cd52f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 35433 microversion: 2.20 time: 0.377190 Sep 08 16:17:46.847580 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 136/276] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:46 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 35433 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:46.879526 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2cd085e8-1356-4cff-8439-dd38caff9112 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:46.889984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2cd085e8-1356-4cff-8439-dd38caff9112 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:46.941502 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2cd085e8-1356-4cff-8439-dd38caff9112 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.945756 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2cd085e8-1356-4cff-8439-dd38caff9112 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:46.947847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2cd085e8-1356-4cff-8439-dd38caff9112 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:46.948975 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2cd085e8-1356-4cff-8439-dd38caff9112 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:47.327518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2cd085e8-1356-4cff-8439-dd38caff9112 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 36331 microversion: 2.1 time: 0.477537 Sep 08 16:17:47.330170 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 137/277] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:46 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 36331 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:47.346750 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:47.364085 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-603b974d-f1d2-41a2-b221-93be3d45ffea tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1510 microversion: 2.1 time: 0.616422 Sep 08 16:17:47.365867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 141/278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:46 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1510 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:47.769934 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:47.771267 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:47.785389 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:47.786187 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:47.787653 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:47.788638 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:47.875443 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-505d46c9-db7e-44d7-ba54-ad3533100f71 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:47.875912 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-505d46c9-db7e-44d7-ba54-ad3533100f71 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:47.889303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505d46c9-db7e-44d7-ba54-ad3533100f71 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:47.890121 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505d46c9-db7e-44d7-ba54-ad3533100f71 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:47.891406 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505d46c9-db7e-44d7-ba54-ad3533100f71 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:47.892187 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505d46c9-db7e-44d7-ba54-ad3533100f71 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:48.133835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:48.144721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-65f11b55-61bb-43dc-809d-1b39904eb590 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1508 microversion: 2.1 time: 0.382783 Sep 08 16:17:48.145436 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 138/279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:47 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:48.341264 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7cfbca40-e2db-447a-b736-9374c1e38449 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:48.342350 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7cfbca40-e2db-447a-b736-9374c1e38449 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:48.351852 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7cfbca40-e2db-447a-b736-9374c1e38449 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:48.352640 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7cfbca40-e2db-447a-b736-9374c1e38449 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:48.353998 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7cfbca40-e2db-447a-b736-9374c1e38449 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:48.354765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7cfbca40-e2db-447a-b736-9374c1e38449 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:50.679994 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-505d46c9-db7e-44d7-ba54-ad3533100f71 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 38177 microversion: 2.20 time: 2.826624 Sep 08 16:17:50.681760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 142/280] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:47 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 38177 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:50.688803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:50.689503 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:50.698791 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:50.699387 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:50.700254 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:50.703051 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:50.730312 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7cfbca40-e2db-447a-b736-9374c1e38449 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 38093 microversion: 2.1 time: 2.392294 Sep 08 16:17:50.737218 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 139/281] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:48 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 38093 bytes in 2395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:17:51.020874 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:51.031213 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-201700d7-8c8c-40f5-b26e-433a448b3071 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1510 microversion: 2.1 time: 0.348090 Sep 08 16:17:51.031910 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 143/282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:50 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:51.697495 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1df4dee0-0c96-494a-9bc1-fec549a3bae7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:51.698391 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1df4dee0-0c96-494a-9bc1-fec549a3bae7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:51.709636 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1df4dee0-0c96-494a-9bc1-fec549a3bae7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:51.711254 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1df4dee0-0c96-494a-9bc1-fec549a3bae7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:51.712117 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1df4dee0-0c96-494a-9bc1-fec549a3bae7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:51.712553 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1df4dee0-0c96-494a-9bc1-fec549a3bae7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:51.746432 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-51ef5e66-a420-47a3-9229-07f364e25f53 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:51.747743 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-51ef5e66-a420-47a3-9229-07f364e25f53 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:51.757232 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51ef5e66-a420-47a3-9229-07f364e25f53 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:51.757876 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51ef5e66-a420-47a3-9229-07f364e25f53 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:51.759047 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51ef5e66-a420-47a3-9229-07f364e25f53 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:51.759737 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-51ef5e66-a420-47a3-9229-07f364e25f53 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:54.574388 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-51ef5e66-a420-47a3-9229-07f364e25f53 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 200 len: 38224 microversion: 2.1 time: 2.832366 Sep 08 16:17:54.575433 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 144/283] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:17:51 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 38224 bytes in 2835 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:17:54.582013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:54.582842 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:54.593413 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:54.593933 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:54.594916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:54.595360 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:54.619757 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1df4dee0-0c96-494a-9bc1-fec549a3bae7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 200 len: 38318 microversion: 2.20 time: 2.926553 Sep 08 16:17:54.621247 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 140/284] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:51 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 38318 bytes in 2929 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:17:54.629089 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c15a161e-d20b-4ad7-ac5c-10f6458ec44b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f58b92-6682-4711-9747-b0d346c1c41d"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:54.630788 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c15a161e-d20b-4ad7-ac5c-10f6458ec44b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:54.646259 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c15a161e-d20b-4ad7-ac5c-10f6458ec44b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:54.647027 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c15a161e-d20b-4ad7-ac5c-10f6458ec44b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:54.648971 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c15a161e-d20b-4ad7-ac5c-10f6458ec44b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:54.649718 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c15a161e-d20b-4ad7-ac5c-10f6458ec44b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:54.943880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:54.953676 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4ac7cdd3-8816-4563-af15-43ce489afa43 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1510 microversion: 2.1 time: 0.376664 Sep 08 16:17:54.954367 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 145/285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:54 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:54.959634 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-07cdb28d-5253-4756-a97e-b999f443d24f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:54.960169 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-07cdb28d-5253-4756-a97e-b999f443d24f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:54.968536 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07cdb28d-5253-4756-a97e-b999f443d24f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:54.968910 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07cdb28d-5253-4756-a97e-b999f443d24f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:54.970047 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07cdb28d-5253-4756-a97e-b999f443d24f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:54.971174 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07cdb28d-5253-4756-a97e-b999f443d24f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:55.037754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-07cdb28d-5253-4756-a97e-b999f443d24f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/ips" status: 200 len: 146 microversion: 2.1 time: 0.082289 Sep 08 16:17:55.038889 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 146/286] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Sep 8 16:17:54 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/ips => generated 146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:55.043899 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a4a32d55-0ad9-4728-b058-853d7745a35c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:55.044395 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a4a32d55-0ad9-4728-b058-853d7745a35c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:55.054268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4a32d55-0ad9-4728-b058-853d7745a35c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:55.054268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4a32d55-0ad9-4728-b058-853d7745a35c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:55.054268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4a32d55-0ad9-4728-b058-853d7745a35c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:55.054722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4a32d55-0ad9-4728-b058-853d7745a35c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:55.124183 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a4a32d55-0ad9-4728-b058-853d7745a35c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/ips" status: 200 len: 152 microversion: 2.20 time: 0.084007 Sep 08 16:17:55.125337 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 147/287] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Sep 8 16:17:55 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/ips => generated 152 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:17:55.276842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c15a161e-d20b-4ad7-ac5c-10f6458ec44b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652452 Sep 08 16:17:55.278088 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 141/288] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:17:54 2021] POST /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:55.985016 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:55.986084 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:55.996524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:55.997161 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:55.998169 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:55.998916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:56.304783 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:56.314734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8ba6eeef-893b-4818-b91d-a324df20b15a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1510 microversion: 2.1 time: 0.341218 Sep 08 16:17:56.315463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 148/289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:55 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:57.336054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:57.337451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:57.346941 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:57.347361 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:57.353425 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:57.353425 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:57.676741 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:57.689138 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-aa6129de-83f7-41ac-9c39-45978ee50de4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1516 microversion: 2.1 time: 0.357403 Sep 08 16:17:57.689878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 142/290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:57 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1516 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:58.719622 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:58.720881 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:58.739008 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:58.739455 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:58.740338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:58.740793 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:58.821266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lazy-loading 'flavor' on Instance uuid b2dd36a3-a4b2-4d0e-8140-e629d0c9954d {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:17:59.216165 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-263732cb-72d4-464e-880e-dee036869a14 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bd72157-f853-4245-992f-f73b97436680"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:59.217291 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-263732cb-72d4-464e-880e-dee036869a14 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:59.225004 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263732cb-72d4-464e-880e-dee036869a14 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:59.225595 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263732cb-72d4-464e-880e-dee036869a14 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:59.226577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263732cb-72d4-464e-880e-dee036869a14 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:59.227022 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-263732cb-72d4-464e-880e-dee036869a14 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:59.345359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-33bbac36-197e-48cb-b849-acd037e1e7d2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 202 len: 0 microversion: 2.20 time: 0.632272 Sep 08 16:17:59.346498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 149/291] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:17:58 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:17:59.355584 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:59.356541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:59.365543 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:59.366487 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:59.367726 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:59.368308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:59.674095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:59.692483 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:59.697103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:59.699353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b61b76d4-4e67-42d4-aa4e-5a983ec72f6f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.347848 Sep 08 16:17:59.700526 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 150/292] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:17:59 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:17:59.844677 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-263732cb-72d4-464e-880e-dee036869a14 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631868 Sep 08 16:17:59.846492 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 143/293] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:17:59 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:59.940852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:59.945098 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:17:59.973302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:59.975765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:17:59.977544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:17:59.978501 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:00.322497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:00.331309 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d932cdb0-4eb3-49ab-ad6c-4d5d7919df93 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1516 microversion: 2.1 time: 0.397995 Sep 08 16:18:00.332055 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 151/294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:17:59 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1516 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:00.360754 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f40433b2-1354-404e-bb79-ed6792a9bd5a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf5b636-cf9f-43a3-a11b-8076fae41f9b"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:00.365203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f40433b2-1354-404e-bb79-ed6792a9bd5a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:00.377213 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f40433b2-1354-404e-bb79-ed6792a9bd5a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:00.377663 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f40433b2-1354-404e-bb79-ed6792a9bd5a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:00.378451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f40433b2-1354-404e-bb79-ed6792a9bd5a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:00.378883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f40433b2-1354-404e-bb79-ed6792a9bd5a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:00.730148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:00.730655 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:00.738986 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:00.739446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:00.740366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:00.741369 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:01.073696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:01.085209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:01.086768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:01.087977 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-12cab04c-8ced-41bb-a1b9-213aed16a593 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.362508 Sep 08 16:18:01.088554 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 152/295] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:00 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:18:02.116605 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:02.117852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:02.131196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:02.132570 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:02.134147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:02.134973 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:02.516985 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:02.533860 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:02.536448 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:02.537698 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f4320a60-9abe-4f59-8dc9-36bcc575e84b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.428561 Sep 08 16:18:02.538518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 153/296] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:02 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:18:03.074027 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f40433b2-1354-404e-bb79-ed6792a9bd5a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.722343 Sep 08 16:18:03.074721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 144/297] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:18:00 2021] POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 194 bytes in 2725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:03.564929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:03.566382 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:03.601869 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:03.603647 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:03.605350 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:03.606125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:03.896264 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:03.915773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:03.918798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:03.920800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9bc6d9e0-f869-464c-84ae-269ca3760633 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.363341 Sep 08 16:18:03.921687 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 154/298] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:03 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:04.949327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:04.951710 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:04.963579 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:04.964172 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:04.965278 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:04.965987 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:05.298354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:05.317878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:05.320080 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:05.321491 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-224946e4-8c4f-4849-8007-230409a00109 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.380862 Sep 08 16:18:05.322557 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 145/299] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:04 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:05.423667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f58b92-6682-4711-9747-b0d346c1c41d"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:05.424852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:05.438612 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:05.439049 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:05.440105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:05.440537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:05.754052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] HTTP exception thrown: Invalid volume: volume d3f58b92-6682-4711-9747-b0d346c1c41d is already attached to instances: 8c08f6f9-7669-40ee-b76b-b418d405c6fd Sep 08 16:18:05.755262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Returning 400 to user: Invalid volume: volume d3f58b92-6682-4711-9747-b0d346c1c41d is already attached to instances: 8c08f6f9-7669-40ee-b76b-b418d405c6fd {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:18:05.757344 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-bd37a401-2010-4344-8bea-51fb77048473 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.339189 Sep 08 16:18:05.758468 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 155/300] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:18:05 2021] POST /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 174 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 16:18:06.007881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:06.009713 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:06.025716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:06.026654 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:06.028079 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:06.029181 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:06.314191 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lazy-loading 'services' on Instance uuid 8c08f6f9-7669-40ee-b76b-b418d405c6fd {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:18:06.362654 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:06.363835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:06.387050 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:06.388658 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:06.391836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:06.392916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:06.513425 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-623ce15d-b53a-4f79-8acb-78dd87e6062c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments/d3f58b92-6682-4711-9747-b0d346c1c41d" status: 202 len: 0 microversion: 2.1 time: 0.512499 Sep 08 16:18:06.514700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 146/301] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:18:05 2021] DELETE /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments/d3f58b92-6682-4711-9747-b0d346c1c41d => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:06.545232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d7077c55-9ebd-413a-85b9-7e0d96055c73 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:06.546460 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d7077c55-9ebd-413a-85b9-7e0d96055c73 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:06.557439 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7077c55-9ebd-413a-85b9-7e0d96055c73 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:06.558263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7077c55-9ebd-413a-85b9-7e0d96055c73 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:06.559533 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7077c55-9ebd-413a-85b9-7e0d96055c73 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:06.560326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d7077c55-9ebd-413a-85b9-7e0d96055c73 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:06.686286 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d7077c55-9ebd-413a-85b9-7e0d96055c73 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145802 Sep 08 16:18:06.686886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 147/302] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:06 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:06.800152 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:06.811503 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:06.813142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:06.814381 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-967c8f39-adc3-4cda-887c-fa1d9a2f7106 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.462720 Sep 08 16:18:06.815027 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 156/303] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:06 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:07.706144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7ebfe77c-d828-46d0-9991-2bc4b6ab1377 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:07.707702 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7ebfe77c-d828-46d0-9991-2bc4b6ab1377 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:07.722335 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ebfe77c-d828-46d0-9991-2bc4b6ab1377 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:07.723424 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ebfe77c-d828-46d0-9991-2bc4b6ab1377 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:07.729314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ebfe77c-d828-46d0-9991-2bc4b6ab1377 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:07.730376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7ebfe77c-d828-46d0-9991-2bc4b6ab1377 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:07.839084 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:07.843959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:07.858902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:07.861885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:07.863844 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:07.864960 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:07.902865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7ebfe77c-d828-46d0-9991-2bc4b6ab1377 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205188 Sep 08 16:18:07.908594 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 148/304] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:07 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:08.109501 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:08.119640 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:08.121523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:08.123490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a7e1c6f4-0260-4195-920e-fcf17648e3dd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.293011 Sep 08 16:18:08.124574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 157/305] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:07 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:08.915346 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-90e72d72-c965-4237-88be-47dd7222fe06 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:08.918100 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-90e72d72-c965-4237-88be-47dd7222fe06 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:08.934549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90e72d72-c965-4237-88be-47dd7222fe06 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:08.936034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90e72d72-c965-4237-88be-47dd7222fe06 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:08.937471 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90e72d72-c965-4237-88be-47dd7222fe06 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:08.938272 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-90e72d72-c965-4237-88be-47dd7222fe06 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:09.067992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-90e72d72-c965-4237-88be-47dd7222fe06 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157066 Sep 08 16:18:09.069515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 149/306] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:08 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:18:09.145885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:09.147464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:09.156865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:09.157787 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:09.158850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:09.159446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:09.459578 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:09.478412 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:09.481673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:09.484205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-592cc487-14e8-466c-8a48-949282d69607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.342475 Sep 08 16:18:09.485557 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 158/307] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:09 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:18:10.081169 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-baeb4332-1fb9-4581-9127-7772f9312140 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:10.082312 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-baeb4332-1fb9-4581-9127-7772f9312140 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:10.091940 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baeb4332-1fb9-4581-9127-7772f9312140 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:10.092572 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baeb4332-1fb9-4581-9127-7772f9312140 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:10.093539 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baeb4332-1fb9-4581-9127-7772f9312140 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:10.094174 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-baeb4332-1fb9-4581-9127-7772f9312140 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:10.173617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-baeb4332-1fb9-4581-9127-7772f9312140 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096641 Sep 08 16:18:10.174750 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 150/308] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:10 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:18:10.514345 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:10.514981 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:10.522979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:10.523525 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:10.524382 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:10.524865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:10.802047 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:10.819651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:10.822978 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:10.825307 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9ebff9f9-2cc1-42d1-b831-a724afe31596 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.314586 Sep 08 16:18:10.826282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 159/309] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:10 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:11.188190 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-bc71b50f-2d7f-4681-a61c-e1bd59f31a75 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:11.189115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-bc71b50f-2d7f-4681-a61c-e1bd59f31a75 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:11.197367 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bc71b50f-2d7f-4681-a61c-e1bd59f31a75 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:11.197818 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bc71b50f-2d7f-4681-a61c-e1bd59f31a75 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:11.198603 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bc71b50f-2d7f-4681-a61c-e1bd59f31a75 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:11.199033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bc71b50f-2d7f-4681-a61c-e1bd59f31a75 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:11.266963 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-bc71b50f-2d7f-4681-a61c-e1bd59f31a75 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082481 Sep 08 16:18:11.267570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 151/310] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:11 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:11.846614 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:11.847638 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:11.857262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:11.857822 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:11.858745 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:11.859259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:12.160186 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:12.172766 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:12.174369 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:12.175652 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0873bbca-7ab2-4f59-8cd7-33f7b390cab0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.333087 Sep 08 16:18:12.176206 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 160/311] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:11 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:12.278513 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ca55107b-3f03-4335-b417-a58b072e3da9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:12.279440 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ca55107b-3f03-4335-b417-a58b072e3da9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:12.288278 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ca55107b-3f03-4335-b417-a58b072e3da9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:12.288726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ca55107b-3f03-4335-b417-a58b072e3da9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:12.289700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ca55107b-3f03-4335-b417-a58b072e3da9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:12.290291 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ca55107b-3f03-4335-b417-a58b072e3da9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:12.383345 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ca55107b-3f03-4335-b417-a58b072e3da9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108546 Sep 08 16:18:12.389269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 152/312] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:12 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:13.195631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:13.196225 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:13.203621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:13.204062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:13.204853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:13.205285 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:13.398670 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d8fb1870-c84f-4af0-8a61-c7cd8d026332 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:13.399861 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d8fb1870-c84f-4af0-8a61-c7cd8d026332 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:13.408629 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d8fb1870-c84f-4af0-8a61-c7cd8d026332 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:13.409174 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d8fb1870-c84f-4af0-8a61-c7cd8d026332 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:13.410048 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d8fb1870-c84f-4af0-8a61-c7cd8d026332 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:13.410551 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d8fb1870-c84f-4af0-8a61-c7cd8d026332 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:13.431229 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:13.450784 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:13.455288 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:13.458398 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3c3c9043-2a28-44f7-a898-cb4638b449a1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.267303 Sep 08 16:18:13.460410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 161/313] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:13 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:13.531531 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d8fb1870-c84f-4af0-8a61-c7cd8d026332 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137570 Sep 08 16:18:13.533734 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 153/314] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:13 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:18:14.482742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:14.483749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:14.498969 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:14.499828 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:14.501249 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:14.502039 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:14.545563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f5728819-1b04-4072-ae20-392c2ee0df10 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:14.546491 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f5728819-1b04-4072-ae20-392c2ee0df10 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:14.555570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5728819-1b04-4072-ae20-392c2ee0df10 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:14.556280 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5728819-1b04-4072-ae20-392c2ee0df10 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:14.557325 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5728819-1b04-4072-ae20-392c2ee0df10 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:14.559526 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5728819-1b04-4072-ae20-392c2ee0df10 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:14.634175 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f5728819-1b04-4072-ae20-392c2ee0df10 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092469 Sep 08 16:18:14.638685 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 154/315] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:14 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:18:14.796156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:14.806063 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:14.808515 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:14.809891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-49aa9d84-75bc-48eb-aabb-d920c42c0444 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.334234 Sep 08 16:18:14.810663 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 162/316] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:14 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:15.648568 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-68f99d30-d303-4ec7-b951-1a957a7a34c1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:15.649996 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-68f99d30-d303-4ec7-b951-1a957a7a34c1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:15.661006 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-68f99d30-d303-4ec7-b951-1a957a7a34c1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:15.661452 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-68f99d30-d303-4ec7-b951-1a957a7a34c1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:15.663192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-68f99d30-d303-4ec7-b951-1a957a7a34c1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:15.664587 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-68f99d30-d303-4ec7-b951-1a957a7a34c1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:15.775856 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-68f99d30-d303-4ec7-b951-1a957a7a34c1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133233 Sep 08 16:18:15.780064 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 155/317] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:15 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:15.825728 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-bdc106ea-29c5-46e0-933c-2e744a99720e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:15.835422 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bdc106ea-29c5-46e0-933c-2e744a99720e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:15.835911 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bdc106ea-29c5-46e0-933c-2e744a99720e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:15.840980 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:15.842356 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:15.874992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:15.875806 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:15.877226 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:15.878263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:15.959949 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-bdc106ea-29c5-46e0-933c-2e744a99720e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Going to try to stop instance {{(pid=93618) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Sep 08 16:18:16.099034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-bdc106ea-29c5-46e0-933c-2e744a99720e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 202 len: 0 microversion: 2.1 time: 0.277405 Sep 08 16:18:16.100561 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 163/318] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:18:15 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:16.110491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:16.111627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:16.121660 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:16.122468 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:16.124490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:16.125273 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:16.202718 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:16.213363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:16.215784 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:16.217451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-dd2a01b6-8770-4471-97f9-071b244b20b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1743 microversion: 2.20 time: 0.388214 Sep 08 16:18:16.218252 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 156/319] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:15 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1743 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:16.392812 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:16.408483 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fb9fe945-b626-4392-b6c1-9a28cb5e8ced tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.302235 Sep 08 16:18:16.409366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 164/320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:16 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:16.788268 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-98aeec3a-f0d3-4411-85a8-c29aae7b99aa tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:16.789292 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-98aeec3a-f0d3-4411-85a8-c29aae7b99aa tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:16.797418 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-98aeec3a-f0d3-4411-85a8-c29aae7b99aa tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:16.797866 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-98aeec3a-f0d3-4411-85a8-c29aae7b99aa tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:16.798671 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-98aeec3a-f0d3-4411-85a8-c29aae7b99aa tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:16.799194 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-98aeec3a-f0d3-4411-85a8-c29aae7b99aa tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:16.869462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-98aeec3a-f0d3-4411-85a8-c29aae7b99aa tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085419 Sep 08 16:18:16.870277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 157/321] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:16 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:18:17.250331 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:17.250962 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:17.259424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:17.259894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:17.260669 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:17.261098 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:17.431787 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:17.432600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:17.442333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:17.442790 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:17.444679 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:17.445356 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:17.644396 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:17.671072 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:17.675141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:17.678919 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-96385e33-f4d6-4a79-b2b1-418904a315bb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1743 microversion: 2.20 time: 0.432298 Sep 08 16:18:17.680489 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 165/322] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:17 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1743 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:18:17.822515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:17.838101 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-17f4ba02-5a46-4059-92e0-59c3c33812cd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.412954 Sep 08 16:18:17.839634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 158/323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:17 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:17.886194 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-472b4ed5-3a68-473e-8927-f3dba637ae71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:17.887767 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-472b4ed5-3a68-473e-8927-f3dba637ae71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:17.916814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-472b4ed5-3a68-473e-8927-f3dba637ae71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:17.917814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-472b4ed5-3a68-473e-8927-f3dba637ae71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:17.921946 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-472b4ed5-3a68-473e-8927-f3dba637ae71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:17.922685 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-472b4ed5-3a68-473e-8927-f3dba637ae71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:18.094512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-472b4ed5-3a68-473e-8927-f3dba637ae71 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213008 Sep 08 16:18:18.096151 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 166/324] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:17 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:18.715435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:18.716870 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:18.732847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:18.734480 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:18.736708 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:18.738462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:18.896521 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:18.900143 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:18.937801 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:18.943402 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:18.946207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:18.948709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:19.277122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:19.301869 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:19.304268 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:19.305269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-882cc29a-46d8-4bc7-92e1-9bd82419cddc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1743 microversion: 2.20 time: 0.597211 Sep 08 16:18:19.305890 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 159/325] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:18 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1743 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:19.317707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4b36ed20-fc10-4df4-ae52-c2e86b251f5c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:19.331096 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4b36ed20-fc10-4df4-ae52-c2e86b251f5c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:19.345380 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b36ed20-fc10-4df4-ae52-c2e86b251f5c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:19.356306 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b36ed20-fc10-4df4-ae52-c2e86b251f5c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:19.357912 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b36ed20-fc10-4df4-ae52-c2e86b251f5c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:19.358835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b36ed20-fc10-4df4-ae52-c2e86b251f5c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:19.391379 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:19.407330 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f64edcd2-f8bb-41f1-9997-547c6e9fecc0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.531549 Sep 08 16:18:19.424094 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 167/326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:18 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:19.435836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-486829608", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1491269323", "security_groups": [{"name": "tempest-secgroup-smoke-2004087972"}], "networks": [{"uuid": "7ca11c1b-7856-4c98-8d2f-ac9178457343"}], "block_device_mapping_v2": [{"uuid": "a038e7b0-7fb2-4efc-97a4-a1dfc4e4acf9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:19.504051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4b36ed20-fc10-4df4-ae52-c2e86b251f5c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194758 Sep 08 16:18:19.509532 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 160/327] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:19 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:19.681594 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] validate_networks() for [('7ca11c1b-7856-4c98-8d2f-ac9178457343', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:18:20.247237 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-81722d31-5e0e-4c9b-a813-a3118bcfdb6e req-0894cd6d-8c0f-4f9d-9bd5-7d057316c506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dd36a3-a4b2-4d0e-8140-e629d0c9954d", "name": "network-vif-plugged", "status": "completed", "tag": "625c811b-4427-4c32-9c2e-61a56adb42db"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:20.257253 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:18:20.257253 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:18:20.295532 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-81722d31-5e0e-4c9b-a813-a3118bcfdb6e req-0894cd6d-8c0f-4f9d-9bd5-7d057316c506 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:20.297383 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-81722d31-5e0e-4c9b-a813-a3118bcfdb6e req-0894cd6d-8c0f-4f9d-9bd5-7d057316c506 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:20.374877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-81722d31-5e0e-4c9b-a813-a3118bcfdb6e req-0894cd6d-8c0f-4f9d-9bd5-7d057316c506 service nova] Creating event network-vif-plugged:625c811b-4427-4c32-9c2e-61a56adb42db for instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d on hv-cinder-80789 Sep 08 16:18:20.383833 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-81722d31-5e0e-4c9b-a813-a3118bcfdb6e req-0894cd6d-8c0f-4f9d-9bd5-7d057316c506 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145000 Sep 08 16:18:20.385607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 161/328] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:18:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:20.393585 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:20.394586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:20.405748 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:20.406265 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:20.407069 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:20.407537 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:20.812675 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:18:20.813376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:18:20.813682 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:18:20.813987 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:18:20.814780 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:18:20.830035 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:20.830816 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:20.832259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:20.833057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:20.887440 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Getting quotas for project 0192ebea3f6246118edb985b970044bc. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:18:20.899778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Getting quotas for user 253dd37a73cd4c5190fb30c9ac3885ee and project 0192ebea3f6246118edb985b970044bc. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:18:20.917322 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:20.926524 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:20.928182 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:20.934018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d85f4ced-6078-435f-b831-65c19e3a981c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.546955 Sep 08 16:18:20.935964 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 162/329] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:20 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:20.948400 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:20.949630 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:20.968801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:20.969529 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:20.973191 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:20.973893 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:21.204451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:18:21.208767 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a038e7b0-7fb2-4efc-97a4-a1dfc4e4acf9',volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:18:21.485873 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:21.514194 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-441146ee-fe89-4a59-8f98-5714ceb5249d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.569855 Sep 08 16:18:21.524269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 163/330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:20 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:21.532858 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b77f132d-98d0-4531-b23a-7deff79d9a2f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:21.545636 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b77f132d-98d0-4531-b23a-7deff79d9a2f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:21.590427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b77f132d-98d0-4531-b23a-7deff79d9a2f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:21.591831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b77f132d-98d0-4531-b23a-7deff79d9a2f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:21.593489 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b77f132d-98d0-4531-b23a-7deff79d9a2f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:21.594594 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b77f132d-98d0-4531-b23a-7deff79d9a2f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:21.633816 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3d052a30-fb6c-41b9-96cd-ce119231eeae tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.208047 Sep 08 16:18:21.636301 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 168/331] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:18:19 2021] POST /compute/v2.1/servers => generated 406 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:18:21.670984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4fce9ca7-71ec-48c9-9866-bff9556b3811 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:21.673883 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4fce9ca7-71ec-48c9-9866-bff9556b3811 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:21.783766 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b77f132d-98d0-4531-b23a-7deff79d9a2f tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.257723 Sep 08 16:18:21.785561 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 164/332] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:21 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:21.817957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4fce9ca7-71ec-48c9-9866-bff9556b3811 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:21.817957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4fce9ca7-71ec-48c9-9866-bff9556b3811 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1088 microversion: 2.1 time: 0.168677 Sep 08 16:18:21.817957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 169/333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:21 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1088 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:21.973898 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:21.975915 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:22.005660 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:22.009565 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:22.019198 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:22.020386 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:22.483924 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:22.519077 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:22.522216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:22.524482 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-06cd9e10-290a-47e7-894c-1e3a0f2db81e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.559015 Sep 08 16:18:22.546751 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:22.556048 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 165/334] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:21 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:22.561893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:22.571365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:22.574082 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:22.577518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:22.579885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:22.802110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-31c988d6-815c-48b9-9320-71229b111db6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:22.804894 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-31c988d6-815c-48b9-9320-71229b111db6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:22.818905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-31c988d6-815c-48b9-9320-71229b111db6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:22.819889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-31c988d6-815c-48b9-9320-71229b111db6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:22.821110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-31c988d6-815c-48b9-9320-71229b111db6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:22.822145 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-31c988d6-815c-48b9-9320-71229b111db6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:23.088796 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-31c988d6-815c-48b9-9320-71229b111db6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.274932 Sep 08 16:18:23.103863 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:23.127659 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 166/335] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:22 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 197 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:18:23.152432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:23.153516 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:23.159139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f8cff6bd-863c-4aef-bda6-865a1fca949c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.617702 Sep 08 16:18:23.169966 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 170/336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:22 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:23.184147 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:23.184779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:23.185793 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:23.186336 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:23.191555 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:23.195326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:23.223440 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:23.225762 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:23.226585 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:23.227209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:23.379192 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lazy-loading 'flavor' on Instance uuid 025be250-ed13-4171-af63-942ce76ab60a {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:18:23.449720 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:23.468681 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-55b535ce-5a41-48ef-bf0e-4d827fc20391 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1130 microversion: 2.1 time: 0.337584 Sep 08 16:18:23.488935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 167/337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:23 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1130 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:23.614831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:23.619712 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:23.654835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:23.656110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:23.658146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:23.659591 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.083165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-71d0d103-a0da-4fe2-a1f8-dbf7ef6280bd tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action" status: 200 len: 32 microversion: 2.1 time: 0.904399 Sep 08 16:18:24.088558 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 171/338] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:18:23 2021] POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action => generated 32 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:18:24.105359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:24.107519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:24.125302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.126105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.127629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.128879 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.139841 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:24.154590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:24.156918 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:24.158600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a6a08938-6442-4ef8-a4f6-5c5b8cbb1f81 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.573797 Sep 08 16:18:24.159409 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 168/339] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:23 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:24.166827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-99fe70c6-4462-41a7-bcd3-d0edba2a202b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:24.168383 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-99fe70c6-4462-41a7-bcd3-d0edba2a202b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:24.177931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-99fe70c6-4462-41a7-bcd3-d0edba2a202b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.178896 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-99fe70c6-4462-41a7-bcd3-d0edba2a202b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.181996 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-99fe70c6-4462-41a7-bcd3-d0edba2a202b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.182969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-99fe70c6-4462-41a7-bcd3-d0edba2a202b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.343311 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-99fe70c6-4462-41a7-bcd3-d0edba2a202b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.182059 Sep 08 16:18:24.344631 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 169/340] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:24 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:18:24.350635 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:24.351797 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:24.378302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.379226 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.380330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.381170 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.872135 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:24.898564 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e6f8a1ea-997b-4980-88c2-be6d18cf4629 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.804262 Sep 08 16:18:24.909251 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 172/341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:24 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:24.918606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:24.925749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:24.935336 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.936013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:24.937026 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:24.937447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:25.275215 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:25.293370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9facac65-305e-4e3b-9c03-1085a63b5dca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.947342 Sep 08 16:18:25.294965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 170/342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:24 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:25.302110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-849439241", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "204b86ab-9a41-430c-b098-cab74514186e"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:25.353706 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:25.374582 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-aee4f5fd-1d59-4a97-9628-f08545fcbf5d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1186 microversion: 2.1 time: 0.463603 Sep 08 16:18:25.375372 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 173/343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:24 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1186 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:25.380862 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:25.385420 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:25.416577 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:25.417024 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:25.417838 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:25.418279 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:25.911068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:25.951511 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:25.957768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:25.960170 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a2b06f4b-34e0-4ea5-b34b-4e621b3f34f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.582908 Sep 08 16:18:25.961017 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 174/344] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:25 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:25.977322 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:25.977932 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:25.990761 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:25.991242 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:25.992097 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:25.999453 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:26.455971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:26.510724 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1c29e10f-3753-4869-a5f7-fb8818a9d118 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.548791 Sep 08 16:18:26.519666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 175/345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:25 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:26.543810 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:26.545033 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:26.556524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:26.557114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:26.558258 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:26.558911 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:27.044246 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:27.066515 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-68410f3b-ebb0-478f-bfba-094b92d6c9de tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.532344 Sep 08 16:18:27.095218 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 176/346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:26 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:27.105243 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:27.106315 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:27.116977 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:27.117955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:27.119234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:27.120323 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:27.346633 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:27.360765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-15817115-f249-4e90-b77c-cd18abcaab3c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1204 microversion: 2.1 time: 0.263331 Sep 08 16:18:27.362026 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 177/347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:27 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1204 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:27.368641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:27.369296 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:27.378555 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:27.379014 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:27.379831 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:27.380834 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:27.620392 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:27.648876 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:27.663546 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:27.663546 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e96dc38c-7b75-4b95-98c8-d588f96a632d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.296210 Sep 08 16:18:27.675650 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 178/348] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:27 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:27.682693 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:27.685527 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:27.710886 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:27.716313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:27.720937 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:27.721871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:28.342457 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:28.376682 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f72ff3bb-0ab4-4b9c-8646-4e9f1640954d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.682269 Sep 08 16:18:28.380056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 179/349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:27 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:28.401255 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:28.404032 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:28.426032 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:28.428498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:28.431957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:28.432848 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:29.144478 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:29.155777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-857fafa4-bd25-4612-bded-bfb7747822ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.773694 Sep 08 16:18:29.162093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 180/350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:28 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:29.176447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:29.177207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:29.201803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:29.203459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:29.205467 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:29.206617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:29.690532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:29.709674 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-197cd575-953c-43d3-b7b8-c2009d670bd4 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.536588 Sep 08 16:18:29.725174 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 181/351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:29 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:29.738426 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:29.752235 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:29.791519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:29.792699 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:29.794729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:29.795496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:30.235636 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:30.258210 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:30.261146 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:30.262850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ba0b2573-d032-48db-9851-4328f85b8fb1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.535928 Sep 08 16:18:30.264045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 182/352] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:29 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:30.276458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:30.282706 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:30.306790 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:30.307528 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:30.311735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:30.312496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:30.808891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:30.822753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f9c905bc-5f4f-4feb-beae-cbf179c70d5c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.557327 Sep 08 16:18:30.827846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 183/353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:30 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:30.846954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:30.848341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:30.873278 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:30.879105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:30.884041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:30.887233 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:31.606661 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:31.626301 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-44b5967a-3446-4419-bad3-8d81808aa9b2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.796858 Sep 08 16:18:31.627632 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 184/354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:30 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:31.633496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:31.634618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:31.643888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:31.645929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:31.647106 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:31.647741 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:32.043788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:32.053172 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-35d89434-62e0-4d5f-b534-92e51db16343 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.424458 Sep 08 16:18:32.054021 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 185/355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:31 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:32.058912 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:32.059550 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:32.068592 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:32.068981 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:32.069780 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:32.070052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:32.374801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] validate_networks() for [('204b86ab-9a41-430c-b098-cab74514186e', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:18:32.446610 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:32.468607 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:32.471119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:32.476215 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d76ad29f-fa8e-4d3d-b557-607b69846b78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.420383 Sep 08 16:18:32.478004 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 186/356] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:32 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:32.493583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-50f818cd-e226-445e-a5de-c8317feb2a08 req-c2436093-ea1d-45e8-aafc-147b6bd9d72c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3b840e-551f-45cd-bbb8-079394ec0f1a", "tag": "6d93681d-822b-4cdf-8b2f-08faccca27db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:32.496919 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:18:32.496919 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:18:32.522015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-50f818cd-e226-445e-a5de-c8317feb2a08 req-c2436093-ea1d-45e8-aafc-147b6bd9d72c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:32.523357 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-50f818cd-e226-445e-a5de-c8317feb2a08 req-c2436093-ea1d-45e8-aafc-147b6bd9d72c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:32.561064 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-50f818cd-e226-445e-a5de-c8317feb2a08 req-c2436093-ea1d-45e8-aafc-147b6bd9d72c service nova] Creating event network-changed:6d93681d-822b-4cdf-8b2f-08faccca27db for instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a on hv-cinder-80789 Sep 08 16:18:32.575130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-50f818cd-e226-445e-a5de-c8317feb2a08 req-c2436093-ea1d-45e8-aafc-147b6bd9d72c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093695 Sep 08 16:18:32.576635 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 187/357] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:18:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:32.589883 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:32.591167 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:32.605411 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:32.606205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:32.607232 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:32.608385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.194358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:33.232590 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-17c09a23-bd8a-4e5e-9350-9b0dc681d352 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.653422 Sep 08 16:18:33.243984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 188/358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:32 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:33.252711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:33.253701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:33.284388 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.285708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.287793 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.289512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.376837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:18:33.377741 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:18:33.378734 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:18:33.379778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:18:33.381982 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:18:33.415862 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.417371 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.419107 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.420283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.471218 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:18:33.481094 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Getting quotas for user 7beb1f9356b8445ebaaf7a422a8aad6b and project c8c774bb92304c42ab3c6d7f2ab7e7dd. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:18:33.507512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:18:33.510037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:18:33.567250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-be19292a-53f4-4465-87c3-843bb6bff9cc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.270921 Sep 08 16:18:33.568563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 171/359] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:18:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 8273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:18:33.573582 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:33.574477 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:33.588004 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.588763 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.589784 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.590416 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.720452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:33.733702 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5cb4566f-8d9d-4e04-be89-4d367a743df1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.488083 Sep 08 16:18:33.734610 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 189/360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:33 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:33.755972 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:33.757021 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:33.777185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.777825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:33.778451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:33.778892 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:34.035027 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:34.055380 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b76be2b7-657b-4e75-b94b-9fbd77b88ccf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.482472 Sep 08 16:18:34.066253 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 172/361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:33 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:34.094080 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cb3fd1f2-4e18-4267-9b95-a0e70c3b2aa0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:34.105988 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cb3fd1f2-4e18-4267-9b95-a0e70c3b2aa0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:34.157120 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:34.170761 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:34.172259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:34.173705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-610e0554-55a5-4e00-af9c-292d5c4ce3d8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.437639 Sep 08 16:18:34.174462 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 190/362] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:33 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:34.258195 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:34.259314 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:34.282004 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:34.282862 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:34.284468 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:34.285736 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:34.300102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cb3fd1f2-4e18-4267-9b95-a0e70c3b2aa0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:34.315252 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cb3fd1f2-4e18-4267-9b95-a0e70c3b2aa0 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1217 microversion: 2.1 time: 0.245492 Sep 08 16:18:34.316013 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 173/363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:34 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:34.761059 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:34.762824 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:34.773905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:34.774546 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:34.775872 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:34.776653 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:34.806013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:34.821189 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b12ef0d3-8288-4c3c-bdee-df05d159f99a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.571164 Sep 08 16:18:34.821765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 191/364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:34 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:35.086563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:35.096275 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:35.140261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:35.144077 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:35.146416 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:35.162342 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:35.751905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:35.824454 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-eb812535-88e0-40c3-8d98-b191e710b5b4 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 1.066806 Sep 08 16:18:35.851400 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 174/365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:34 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:35.881963 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:35.886826 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:35.926727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:35.927634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:35.945385 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:35.949762 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:36.124239 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:36.151927 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-437c9b3c-27ba-422d-8774-f5a439794879 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 1.079405 Sep 08 16:18:36.161515 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 192/366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:35 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:36.169728 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:36.170783 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:36.209706 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:36.210231 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:36.213259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:36.213786 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:36.648962 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:36.711413 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e3e25721-7617-45c3-9d9d-fda2140999e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1269 microversion: 2.1 time: 0.547511 Sep 08 16:18:36.718861 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:36.733633 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 193/367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:36 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1269 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:36.742813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:36.743938 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:36.756434 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:36.776366 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:36.776835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:36.777468 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:36.777731 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3e204789-d341-4d77-aafa-2801efe9eee7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.924978 Sep 08 16:18:36.778639 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 175/368] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:35 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:36.778894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:36.779664 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:36.857643 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:36.858689 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:36.911444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:36.919021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:36.924835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:36.933571 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:37.596068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:37.630843 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4627935a-15c9-4ca0-b86e-09ebf19e6dce tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.890379 Sep 08 16:18:37.632009 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 194/369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:36 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:37.647020 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:37.648439 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:37.669314 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:37.669782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:37.670522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:37.673224 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:37.674935 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:37.682110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-93ebf0bd-70e9-409d-a36a-47695dd7f78c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.828900 Sep 08 16:18:37.683249 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 176/370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:36 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:37.741971 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:37.742692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:37.752443 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:37.752905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:37.753847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:37.754484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:37.937562 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:37.956882 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-bcac335c-8bed-4ac5-b311-2a2f11fe47c3 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1275 microversion: 2.1 time: 0.218942 Sep 08 16:18:37.961056 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 177/371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:37 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:37.967094 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:37.974890 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:37.991394 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:37.993137 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:37.995603 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:37.996648 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:38.132536 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:38.148943 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-117bcc30-ac43-4eae-b6c6-6d5a0576da85 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.515351 Sep 08 16:18:38.150370 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 195/372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:37 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:38.659052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:38.659762 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:38.676058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:38.676509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:38.677385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:38.677824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:39.030162 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:39.043289 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:39.065150 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:39.072996 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8fb27226-2980-41cc-b8ac-76f8dd390e4c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.417425 Sep 08 16:18:39.075184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:39.081865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 196/373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:38 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:39.087452 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-05adc524-8ebd-4b35-9e75-0a2f11295fa7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 1.124484 Sep 08 16:18:39.088427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 178/374] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:37 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:39.106587 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:39.107115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:39.111262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:39.111797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:39.126763 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:39.127221 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:39.130271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:39.130736 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:39.134376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:39.135174 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:39.136323 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:39.138734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:39.788518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:39.793951 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:39.798819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8a56c6e8-4408-4a40-b64f-7133fcb43f7a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.715432 Sep 08 16:18:39.809744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 197/375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:39 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:39.809744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:39.809744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:39.814883 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:39.815132 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:39.816531 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:39.818223 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:39.830907 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-185e08b9-a5b2-4394-b632-e42e97f6a4be tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 0.729219 Sep 08 16:18:39.835710 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 179/376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:39 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:40.102534 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:40.104649 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:40.136658 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:40.147617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7928f3df-d890-4057-949e-409f09950213 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.346427 Sep 08 16:18:40.148766 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 198/377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:39 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:40.154213 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:40.155300 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:40.161925 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.162986 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:40.165028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.165959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:40.167503 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.168670 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:40.170518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.171521 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:40.725831 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:40.735747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:40.737292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:40.742303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-56c3430b-82e3-4e71-a484-2148025cf21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.588640 Sep 08 16:18:40.748878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:40.760468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7fb9fae9-8457-4185-8955-9819849ea5e4 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.666798 Sep 08 16:18:40.761133 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 199/378] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:40 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:40.762504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 180/379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:40 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:40.817693 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:40.819216 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:40.834040 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.838707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:40.840260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.840981 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:40.866581 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:40.868834 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:40.888672 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.891013 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:40.893498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:40.894413 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:41.438621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:41.452021 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-55ebf18e-9405-4abb-a70a-11d24acff566 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.637555 Sep 08 16:18:41.464969 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 200/380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:40 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:41.477117 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:41.478028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:41.493400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:41.495125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:41.496573 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:41.498903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:42.012853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:42.061649 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b55f4d55-4d9b-4713-a343-5908b3db18ca tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 1.204616 Sep 08 16:18:42.062710 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 181/381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:40 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:42.099340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-f49e6336-97c9-41b5-a08d-719e75d7fea4 req-97acf1dd-e299-4dd0-972c-ce8a86447653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b41dcee-c75d-451b-a235-a2c3350c0507", "tag": "404552c2-bd69-4d33-bd70-44e44802af54"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:42.106136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:18:42.106136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:18:42.126367 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f49e6336-97c9-41b5-a08d-719e75d7fea4 req-97acf1dd-e299-4dd0-972c-ce8a86447653 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:42.127091 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f49e6336-97c9-41b5-a08d-719e75d7fea4 req-97acf1dd-e299-4dd0-972c-ce8a86447653 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:42.212162 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-f49e6336-97c9-41b5-a08d-719e75d7fea4 req-97acf1dd-e299-4dd0-972c-ce8a86447653 service nova] Creating event network-changed:404552c2-bd69-4d33-bd70-44e44802af54 for instance 6b41dcee-c75d-451b-a235-a2c3350c0507 on hv-cinder-80789 Sep 08 16:18:42.238620 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-f49e6336-97c9-41b5-a08d-719e75d7fea4 req-97acf1dd-e299-4dd0-972c-ce8a86447653 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164516 Sep 08 16:18:42.241721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 182/382] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:18:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:42.253750 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:42.256320 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:42.274106 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:42.275046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:42.277499 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:42.278490 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:42.338396 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:42.367157 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-20f5a147-4ad7-44c9-bf01-20256b875b66 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.899264 Sep 08 16:18:42.381457 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 201/383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:41 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:42.425130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:42.427271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:42.456535 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:42.459308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:42.466519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:42.477119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:43.261092 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:43.289412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:43.291243 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:43.295316 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:43.299905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ecaa3b4c-ebf4-4ad5-a7c1-2a90d176c7e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 1.054566 Sep 08 16:18:43.302651 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 183/384] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:42 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:43.311880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:43.313677 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:43.314569 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6811a4de-820f-4601-98b1-3da7b2af1b96 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.929352 Sep 08 16:18:43.332271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 202/385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:42 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:43.333333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:43.335034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:43.337367 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:43.338961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:43.342728 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:43.343829 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:43.358260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:43.358985 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:43.360599 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:43.361351 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:44.002046 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:44.013444 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c3a46a2d-0801-4552-aa87-12733300b1e9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 0.679399 Sep 08 16:18:44.045858 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 203/386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:43 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:44.057981 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:44.059857 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:44.079104 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:44.080550 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:44.082653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:44.084355 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:44.085829 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:44.117035 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-614f287c-b17f-4f90-a857-12fa1346b5c1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.811830 Sep 08 16:18:44.120652 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 184/387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:43 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:44.340422 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:44.342750 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:44.356709 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:44.357741 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:44.359299 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:44.360519 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:44.581670 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:44.610418 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d00a94dd-7a2d-4d1d-b79f-08cd81261e81 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.562036 Sep 08 16:18:44.623720 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 204/388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:44 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:44.657294 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:44.664851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:44.697824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:44.699015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:44.701038 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:44.712123 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:45.180758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:45.213306 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:45.217031 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:45.221682 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d5b2e85c-e87c-454d-9450-a1206a6b972e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1738 microversion: 2.20 time: 0.891154 Sep 08 16:18:45.224357 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 185/389] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:44 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1738 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:18:45.237480 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:45.242827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:45.265963 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:45.267253 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:45.270259 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:45.271074 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:45.550720 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:45.572244 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-75c8194a-43b9-4877-8dc2-fefbdf692cad tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.939714 Sep 08 16:18:45.583522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 205/390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:44 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:45.593414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:45.593414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:45.609465 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:45.611381 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:45.613112 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:45.614642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:45.959633 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:45.983935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6f49da2e-4cff-4269-9eb0-82b4b48377e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 0.756408 Sep 08 16:18:45.985736 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 186/391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:45 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:45.996464 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:45.998933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:46.025420 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:46.026729 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:46.028905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:46.029969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:46.303894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:46.322875 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4c548df6-b6d1-425e-852b-a95815a1d3aa tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1724 microversion: 2.1 time: 0.745908 Sep 08 16:18:46.325074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 206/392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:45 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1724 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:46.335083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:46.336266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:46.351717 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:46.352551 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:46.354757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:46.356691 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:46.494976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:46.543357 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-62958d1e-1135-4405-8a3b-f7a127ed046e tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.555472 Sep 08 16:18:46.544726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 187/393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:45 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:46.610033 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:46.616880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:46.642189 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:46.644954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:46.652592 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:46.659068 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.006418 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:47.021069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:47.026286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:47.033743 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f7e69bc7-6c68-420f-bae3-822058188d44 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1720 microversion: 2.20 time: 0.707097 Sep 08 16:18:47.045466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 207/394] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:46 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1720 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:47.050522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-27f75504-d85e-4b9d-b62b-232c9cff1e1a req-3eec3e6c-b4aa-49aa-ba83-44cff212500c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dd36a3-a4b2-4d0e-8140-e629d0c9954d", "name": "network-vif-unplugged", "status": "completed", "tag": "625c811b-4427-4c32-9c2e-61a56adb42db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:47.052666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:18:47.052666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:18:47.064383 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-27f75504-d85e-4b9d-b62b-232c9cff1e1a req-3eec3e6c-b4aa-49aa-ba83-44cff212500c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.065484 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-27f75504-d85e-4b9d-b62b-232c9cff1e1a req-3eec3e6c-b4aa-49aa-ba83-44cff212500c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.087341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-27f75504-d85e-4b9d-b62b-232c9cff1e1a req-3eec3e6c-b4aa-49aa-ba83-44cff212500c service nova] Creating event network-vif-unplugged:625c811b-4427-4c32-9c2e-61a56adb42db for instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d on hv-cinder-80789 Sep 08 16:18:47.095133 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-27f75504-d85e-4b9d-b62b-232c9cff1e1a req-3eec3e6c-b4aa-49aa-ba83-44cff212500c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047969 Sep 08 16:18:47.097086 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 208/395] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:18:47 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:47.109624 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:47.111215 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:47.121480 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.122194 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.123380 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.124155 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.363796 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:47.376335 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-40c73204-e91c-458f-81c1-79d6c945d2dc tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1568 microversion: 2.1 time: 0.776809 Sep 08 16:18:47.377520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 188/396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:46 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1568 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:47.384223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:47.385102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:47.402328 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.403254 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.405148 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.406062 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.519535 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:47.537571 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2af95d26-03a0-4367-98e5-b4eb29acd3f7 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 0.437776 Sep 08 16:18:47.538320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 209/397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:47 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:47.578851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:47.580757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:47.599644 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.600434 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.603158 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.604511 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:47.867583 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:47.885910 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d60c8950-cc8a-4a73-a5e2-6cb119a6dfc3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1701 microversion: 2.1 time: 0.506836 Sep 08 16:18:47.901043 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 189/398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:47 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1701 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:47.917073 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-55b318ad-181f-4d78-bf32-bb4d59521ebe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:47.937043 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b318ad-181f-4d78-bf32-bb4d59521ebe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:47.938212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b318ad-181f-4d78-bf32-bb4d59521ebe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:48.120380 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-55b318ad-181f-4d78-bf32-bb4d59521ebe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Going to try to start instance {{(pid=93617) start /opt/stack/nova/nova/compute/api.py:2625}} Sep 08 16:18:48.214110 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:48.229374 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0771c289-1d5e-476f-b514-f20ecc81425a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.662162 Sep 08 16:18:48.230760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 210/399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:47 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:48.250481 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:48.251057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:48.272968 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:48.274930 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:48.276458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:48.277518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:48.339340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-55b318ad-181f-4d78-bf32-bb4d59521ebe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 202 len: 0 microversion: 2.1 time: 0.433105 Sep 08 16:18:48.341533 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 190/400] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:18:47 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:48.385763 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:48.388393 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:48.406378 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:48.407639 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:48.422851 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:48.425250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.165014 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:49.190891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:49.196361 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:49.200624 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9fadd3f4-1dff-45a7-8717-c474c77d9cb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1720 microversion: 2.20 time: 0.967978 Sep 08 16:18:49.202000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 211/401] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:48 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1720 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:49.213400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:49.215113 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:49.234987 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:49.237650 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.239673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.241386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.242347 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.245556 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-54492d55-23c8-452e-9ae7-834626faa115 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1710 microversion: 2.1 time: 0.886123 Sep 08 16:18:49.248877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 191/402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:48 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1710 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:49.254370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:49.255044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:49.264084 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.264536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.265361 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.265802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.657711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:49.714131 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-61753b1c-4f7f-49ca-90df-99572848fc98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1548 microversion: 2.1 time: 0.509139 Sep 08 16:18:49.725648 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 212/403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:49 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1548 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:49.726693 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:49.755177 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-4c0691bf-676f-4306-9edf-7482f6b20126 req-81b07f43-beb3-41b9-b690-333d3da7b2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3b840e-551f-45cd-bbb8-079394ec0f1a", "name": "network-vif-plugged", "status": "completed", "tag": "6d93681d-822b-4cdf-8b2f-08faccca27db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:49.758353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:18:49.758353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:18:49.767115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9ab03648-d013-4c9c-accb-694af6ee68b4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 0.516086 Sep 08 16:18:49.773357 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 192/404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:49 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:49.791259 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:49.792942 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:49.793137 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-4c0691bf-676f-4306-9edf-7482f6b20126 req-81b07f43-beb3-41b9-b690-333d3da7b2ab service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.793877 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-4c0691bf-676f-4306-9edf-7482f6b20126 req-81b07f43-beb3-41b9-b690-333d3da7b2ab service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.812003 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.813484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.815790 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.817326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.853825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-4c0691bf-676f-4306-9edf-7482f6b20126 req-81b07f43-beb3-41b9-b690-333d3da7b2ab service nova] Creating event network-vif-plugged:6d93681d-822b-4cdf-8b2f-08faccca27db for instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a on hv-cinder-80789 Sep 08 16:18:49.868258 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-4c0691bf-676f-4306-9edf-7482f6b20126 req-81b07f43-beb3-41b9-b690-333d3da7b2ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140535 Sep 08 16:18:49.874313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 213/405] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:49.915734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:49.919756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:49.947334 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.948502 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:49.954858 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:49.956703 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:50.373330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:50.431111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1e092a37-9fd9-4852-b158-f9701891add1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.651204 Sep 08 16:18:50.433045 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 193/406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:49 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:50.454858 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:50.456774 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:50.490427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:50.493967 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:50.512317 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:50.512832 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:50.812727 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] HTTP exception thrown: Cannot 'detach_volume' instance 025be250-ed13-4171-af63-942ce76ab60a while it is in vm_state rescued Sep 08 16:18:50.813789 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Returning 409 to user: Cannot 'detach_volume' instance 025be250-ed13-4171-af63-942ce76ab60a while it is in vm_state rescued {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:18:50.815383 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8835bf1b-633d-4cef-9fdb-61ea4c9c6287 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments/fcf5b636-cf9f-43a3-a11b-8076fae41f9b" status: 409 len: 152 microversion: 2.1 time: 0.937673 Sep 08 16:18:50.822979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 214/407] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:18:49 2021] DELETE /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments/fcf5b636-cf9f-43a3-a11b-8076fae41f9b => generated 152 bytes in 948 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 16:18:50.840560 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:50.841642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:50.876781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:50.877611 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:50.879120 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:50.905607 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:51.464219 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:51.479057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:51.483249 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:51.487700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fc696d96-4faa-48ef-9a98-2fedc69c1756 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1723 microversion: 2.20 time: 1.048904 Sep 08 16:18:51.489861 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 194/408] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:50 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1723 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:51.498882 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:51.499966 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:51.514228 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:51.515100 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:51.526936 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:51.527818 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:51.759335 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:51.779261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e73e7bac-acf7-4025-b6a1-ba47eabe966c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1710 microversion: 2.1 time: 0.953970 Sep 08 16:18:51.780820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 215/409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:50 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1710 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:51.790798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f58c2033-e4f8-4e74-bb8c-155fb1b62334 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:51.792580 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f58c2033-e4f8-4e74-bb8c-155fb1b62334 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:51.810218 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f58c2033-e4f8-4e74-bb8c-155fb1b62334 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:51.811209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f58c2033-e4f8-4e74-bb8c-155fb1b62334 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:51.813262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f58c2033-e4f8-4e74-bb8c-155fb1b62334 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:51.814643 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f58c2033-e4f8-4e74-bb8c-155fb1b62334 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:51.934781 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:51.951765 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1473d311-56e1-45d4-bbce-55b454122ba8 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 0.459823 Sep 08 16:18:51.975542 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 195/410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:51 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:51.987714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:51.989790 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:52.005302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:52.006111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:52.007805 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:52.008768 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:52.152959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f58c2033-e4f8-4e74-bb8c-155fb1b62334 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action" status: 202 len: 0 microversion: 2.1 time: 0.360174 Sep 08 16:18:52.154471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 216/411] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:18:51 2021] POST /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:52.176829 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0a11d870-9112-49f2-8378-007410580e56 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87d249c5-9eba-447d-bb7a-b749ba95cae0"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:52.178638 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0a11d870-9112-49f2-8378-007410580e56 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:52.204721 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a11d870-9112-49f2-8378-007410580e56 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:52.207074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a11d870-9112-49f2-8378-007410580e56 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:52.208604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a11d870-9112-49f2-8378-007410580e56 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:52.210920 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a11d870-9112-49f2-8378-007410580e56 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:52.679711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:52.713519 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d797d350-bef4-4a13-ad39-69230c2d5cb0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1260 microversion: 2.1 time: 0.735035 Sep 08 16:18:52.732558 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 196/412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:51 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1260 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:52.756928 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-1cc1de53-80b4-4d66-8354-b128f2a7830c req-b7e837e5-708b-4391-ac20-285d81df1094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41dcee-c75d-451b-a235-a2c3350c0507", "name": "network-vif-plugged", "status": "completed", "tag": "404552c2-bd69-4d33-bd70-44e44802af54"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:52.767978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:18:52.767978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:18:52.781794 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-1cc1de53-80b4-4d66-8354-b128f2a7830c req-b7e837e5-708b-4391-ac20-285d81df1094 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:52.782501 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-1cc1de53-80b4-4d66-8354-b128f2a7830c req-b7e837e5-708b-4391-ac20-285d81df1094 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:52.810898 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-1cc1de53-80b4-4d66-8354-b128f2a7830c req-b7e837e5-708b-4391-ac20-285d81df1094 service nova] Creating event network-vif-plugged:404552c2-bd69-4d33-bd70-44e44802af54 for instance 6b41dcee-c75d-451b-a235-a2c3350c0507 on hv-cinder-80789 Sep 08 16:18:52.818837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-1cc1de53-80b4-4d66-8354-b128f2a7830c req-b7e837e5-708b-4391-ac20-285d81df1094 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081563 Sep 08 16:18:52.820095 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 197/413] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:18:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:52.830205 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:52.831107 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:52.846816 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:52.848041 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:52.850505 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:52.851911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:53.398030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0a11d870-9112-49f2-8378-007410580e56 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.232581 Sep 08 16:18:53.399170 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 217/414] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Sep 8 16:18:52 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments => generated 188 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:18:53.404254 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:53.405396 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:53.437033 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:53.440564 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:53.447115 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:53.449156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:53.469616 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:53.487703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-374172d1-6aec-4899-a828-0ed8d5060010 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1556 microversion: 2.1 time: 0.663317 Sep 08 16:18:53.489302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 198/415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:52 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1556 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:53.501536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:53.505591 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:53.525559 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:53.526412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:53.529122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:53.530919 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.064231 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:54.091668 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b599920d-5138-4099-9767-1566f5ad8cda tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1714 microversion: 2.1 time: 0.690196 Sep 08 16:18:54.093670 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 218/416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:53 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1714 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:54.104480 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:54.106303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:54.123263 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.124526 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.126268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.127708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.180705 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:54.194225 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2626453a-b231-4fd8-82f8-04c6d94d6db4 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1317 microversion: 2.1 time: 0.701055 Sep 08 16:18:54.195408 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 199/417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:53 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1317 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:54.201349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1080daf6-0ab7-4259-bbee-05fd4385d814 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:54.203198 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1080daf6-0ab7-4259-bbee-05fd4385d814 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:54.213507 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1080daf6-0ab7-4259-bbee-05fd4385d814 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.214183 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1080daf6-0ab7-4259-bbee-05fd4385d814 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.215190 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1080daf6-0ab7-4259-bbee-05fd4385d814 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.215861 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1080daf6-0ab7-4259-bbee-05fd4385d814 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.403726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1080daf6-0ab7-4259-bbee-05fd4385d814 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action" status: 202 len: 0 microversion: 2.20 time: 0.206912 Sep 08 16:18:54.404709 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 200/418] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:18:54 2021] POST /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:18:54.415202 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:54.416759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:54.425460 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.427438 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.428427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.429087 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.848883 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:54.860605 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6ed938d3-901f-4654-997e-6316e01beea7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1443 microversion: 2.1 time: 0.764789 Sep 08 16:18:54.861805 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 219/419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:54 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1443 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:54.869703 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:54.870874 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:54.879873 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.880787 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.881890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.882664 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.915351 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:54.929186 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:54.931361 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:54.933707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ddc24cd6-2d71-4123-a3c0-706ad6e6e4ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1749 microversion: 2.20 time: 0.523221 Sep 08 16:18:54.934911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 201/420] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:54 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1749 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:18:54.940630 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:54.941615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:54.950860 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.951776 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:54.953245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:54.954022 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:55.724919 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:55.730350 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:55.740809 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-928d3545-9c9c-4577-bedc-b2d2e25dbac1 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1443 microversion: 2.1 time: 0.804502 Sep 08 16:18:55.742828 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3c878cc3-823a-4c31-9506-4b57afc6d483 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1556 microversion: 2.1 time: 0.879174 Sep 08 16:18:55.744965 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 220/421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:54 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1556 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:55.758954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 202/422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:54 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1443 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:55.771491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:55.772650 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:55.787502 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:55.788197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:55.789545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:55.790315 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:55.994359 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:55.995900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:56.015251 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:56.024320 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:56.025928 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:56.027061 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:56.470207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:56.487602 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-cc948bf3-2edb-440b-9e89-12994c997bd9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1507 microversion: 2.1 time: 0.738706 Sep 08 16:18:56.492153 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 221/423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:55 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1507 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:56.642375 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:56.661833 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:56.664190 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:56.665568 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a3244f24-7c5f-4715-a388-eb9d161cabee tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1749 microversion: 2.20 time: 0.677483 Sep 08 16:18:56.681260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 203/424] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:55 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1749 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:56.767232 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:56.768805 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:56.801950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:56.807276 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:56.809209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:56.812421 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:57.313760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:57.325054 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-06ae7954-0822-462c-adec-7e1ab6bdbe7d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1556 microversion: 2.1 time: 0.566881 Sep 08 16:18:57.326559 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 222/425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:56 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1556 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:57.690426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:57.691022 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:57.699586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:57.700044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:57.700874 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:57.701316 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:57.998030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:58.014414 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:58.016396 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:58.018544 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a1566855-9168-4b0a-b39d-fe3778710231 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1751 microversion: 2.20 time: 0.331784 Sep 08 16:18:58.019636 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 204/426] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:57 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1751 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:58.343808 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:58.345134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:58.354273 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:58.355072 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:58.356063 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:58.356663 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:58.663398 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-21334b58-935d-4279-a98c-6d8887a75e32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2346dc78-158e-4d2b-b765-e9ee0f91980d"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:58.665545 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-21334b58-935d-4279-a98c-6d8887a75e32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:58.677904 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-21334b58-935d-4279-a98c-6d8887a75e32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:58.678880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-21334b58-935d-4279-a98c-6d8887a75e32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:58.680365 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-21334b58-935d-4279-a98c-6d8887a75e32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:58.681469 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-21334b58-935d-4279-a98c-6d8887a75e32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:58.727741 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:58.737980 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5fc23a57-3a02-4ea2-a0ba-8e2f719814e3 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1562 microversion: 2.1 time: 0.398047 Sep 08 16:18:58.750466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 223/427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:18:58 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1562 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:59.045074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:59.047797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:59.067374 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:59.068119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:59.079868 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:59.081544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:59.386831 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:59.413764 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:59.417084 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:59.419291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e589a2f0-843b-444a-9974-d19717d2c259 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1751 microversion: 2.20 time: 0.383752 Sep 08 16:18:59.421056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 224/428] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:18:59 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1751 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:18:59.439857 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:59.440668 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:59.450827 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:59.452140 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:59.453440 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:59.454060 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:59.566959 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-21334b58-935d-4279-a98c-6d8887a75e32 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "POST /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911367 Sep 08 16:18:59.569676 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 205/429] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:18:58 2021] POST /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:59.674227 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lazy-loading 'services' on Instance uuid 025be250-ed13-4171-af63-942ce76ab60a {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:18:59.900446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4dde6af0-c8b1-4ca4-94d7-71f6c45bc829 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments/fcf5b636-cf9f-43a3-a11b-8076fae41f9b" status: 202 len: 0 microversion: 2.1 time: 0.467262 Sep 08 16:18:59.901317 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 225/430] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:18:59 2021] DELETE /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments/fcf5b636-cf9f-43a3-a11b-8076fae41f9b => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:59.912382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-948be028-0c0b-469c-b865-040e7b312fc9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:59.913859 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-948be028-0c0b-469c-b865-040e7b312fc9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:18:59.927364 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-948be028-0c0b-469c-b865-040e7b312fc9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:59.934638 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-948be028-0c0b-469c-b865-040e7b312fc9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:18:59.937152 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-948be028-0c0b-469c-b865-040e7b312fc9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:18:59.946645 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-948be028-0c0b-469c-b865-040e7b312fc9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:00.039428 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-948be028-0c0b-469c-b865-040e7b312fc9 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132878 Sep 08 16:19:00.040428 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 206/431] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:18:59 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:00.439213 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:00.439950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:00.448823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:00.449273 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:00.450339 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:00.450886 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:00.707577 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:00.729266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:00.733731 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:00.736538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7993bc86-85ae-4387-8312-41e77c46a920 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.301126 Sep 08 16:19:00.737452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 226/432] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:00 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:01.006715 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-dcc1c1b1-9f65-4ac5-b874-6ab36e6fc981 req-cb67fd0d-f4a4-49b1-9b41-d6196739fcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3b840e-551f-45cd-bbb8-079394ec0f1a", "tag": "6d93681d-822b-4cdf-8b2f-08faccca27db"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:01.009192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:01.009192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:19:01.020258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-dcc1c1b1-9f65-4ac5-b874-6ab36e6fc981 req-cb67fd0d-f4a4-49b1-9b41-d6196739fcd5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:01.022551 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-dcc1c1b1-9f65-4ac5-b874-6ab36e6fc981 req-cb67fd0d-f4a4-49b1-9b41-d6196739fcd5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:01.045910 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-dcc1c1b1-9f65-4ac5-b874-6ab36e6fc981 req-cb67fd0d-f4a4-49b1-9b41-d6196739fcd5 service nova] Creating event network-changed:6d93681d-822b-4cdf-8b2f-08faccca27db for instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a on hv-cinder-80789 Sep 08 16:19:01.056052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ea8ba822-9925-4985-a416-48c94262a189 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:01.059058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ea8ba822-9925-4985-a416-48c94262a189 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:01.089243 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-dcc1c1b1-9f65-4ac5-b874-6ab36e6fc981 req-cb67fd0d-f4a4-49b1-9b41-d6196739fcd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088104 Sep 08 16:19:01.090589 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 207/433] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:01.091500 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ea8ba822-9925-4985-a416-48c94262a189 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:01.092188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ea8ba822-9925-4985-a416-48c94262a189 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:01.093293 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ea8ba822-9925-4985-a416-48c94262a189 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:01.094847 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ea8ba822-9925-4985-a416-48c94262a189 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:01.190162 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ea8ba822-9925-4985-a416-48c94262a189 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140551 Sep 08 16:19:01.191399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 227/434] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:01 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:01.769300 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:01.771099 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:01.788157 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:01.790503 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:01.792160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:01.795635 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:02.206512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:02.212902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0a251808-4006-4314-8396-0acbd8038e9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:02.215665 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0a251808-4006-4314-8396-0acbd8038e9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:02.249514 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:02.251740 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:02.252936 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-052d76d5-34fb-4fbe-8828-0a9563872e0b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.489157 Sep 08 16:19:02.254122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 208/435] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:01 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:02.265066 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a251808-4006-4314-8396-0acbd8038e9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:02.266424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a251808-4006-4314-8396-0acbd8038e9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:02.268497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a251808-4006-4314-8396-0acbd8038e9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:02.269386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0a251808-4006-4314-8396-0acbd8038e9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:02.468362 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0a251808-4006-4314-8396-0acbd8038e9f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.265024 Sep 08 16:19:02.472368 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 228/436] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:02 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:03.276861 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:03.279277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:03.297889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:03.298688 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:03.300392 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:03.301397 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:03.490337 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-be3d86e6-dc39-41cc-b90d-c957ffb96145 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:03.493318 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-be3d86e6-dc39-41cc-b90d-c957ffb96145 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:03.526167 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be3d86e6-dc39-41cc-b90d-c957ffb96145 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:03.527719 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be3d86e6-dc39-41cc-b90d-c957ffb96145 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:03.535631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be3d86e6-dc39-41cc-b90d-c957ffb96145 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:03.536712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be3d86e6-dc39-41cc-b90d-c957ffb96145 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:03.766538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-be3d86e6-dc39-41cc-b90d-c957ffb96145 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.284132 Sep 08 16:19:03.778968 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:03.783235 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 229/437] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:03 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:03.804703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:03.807732 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:03.809825 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-db162ff8-250a-4fe2-962d-6ffb512d842a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.540549 Sep 08 16:19:03.812124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 209/438] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:03 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:04.799123 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1963e993-80d6-4537-8373-f9c34c14268e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:04.801794 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1963e993-80d6-4537-8373-f9c34c14268e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:04.821647 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1963e993-80d6-4537-8373-f9c34c14268e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:04.843530 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:04.843530 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:04.845386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1963e993-80d6-4537-8373-f9c34c14268e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:04.847666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1963e993-80d6-4537-8373-f9c34c14268e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:04.851750 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1963e993-80d6-4537-8373-f9c34c14268e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:04.872994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:04.877240 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:04.880342 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:04.890002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:05.185917 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1963e993-80d6-4537-8373-f9c34c14268e tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.393355 Sep 08 16:19:05.192270 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 230/439] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:04 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:05.642407 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:05.672863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:05.677603 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:05.679961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ec807b0c-e3c1-4280-9c7e-363733f1ddbc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.851405 Sep 08 16:19:05.692470 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 210/440] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:04 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:06.203512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a548ce16-619b-40fd-b0d5-ec4fe7275337 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:06.210497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a548ce16-619b-40fd-b0d5-ec4fe7275337 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:06.229043 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a548ce16-619b-40fd-b0d5-ec4fe7275337 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:06.230057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a548ce16-619b-40fd-b0d5-ec4fe7275337 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:06.232050 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a548ce16-619b-40fd-b0d5-ec4fe7275337 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:06.233062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a548ce16-619b-40fd-b0d5-ec4fe7275337 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:06.399000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a548ce16-619b-40fd-b0d5-ec4fe7275337 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203341 Sep 08 16:19:06.403858 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 231/441] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:06 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:06.711050 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:06.711904 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:06.726909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:06.727360 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:06.729915 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:06.733656 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:07.099018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:07.109223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:07.110975 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:07.112557 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f9dc9edf-58ce-4039-920d-5bb53f2b1448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.406085 Sep 08 16:19:07.114309 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 211/442] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:06 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:07.414520 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-aeec415f-b20d-4e34-a06e-974cea33c534 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:07.416596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-aeec415f-b20d-4e34-a06e-974cea33c534 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:07.429812 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aeec415f-b20d-4e34-a06e-974cea33c534 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:07.431103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aeec415f-b20d-4e34-a06e-974cea33c534 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:07.432893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aeec415f-b20d-4e34-a06e-974cea33c534 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:07.434000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aeec415f-b20d-4e34-a06e-974cea33c534 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:07.545248 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-aeec415f-b20d-4e34-a06e-974cea33c534 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137987 Sep 08 16:19:07.546683 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 232/443] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:07 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:08.136287 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:08.137222 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:08.156798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:08.157348 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:08.158204 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:08.161617 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:08.455507 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:08.478608 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:08.481935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:08.484389 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4c503353-586b-4435-8231-e84de9f292f0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.353744 Sep 08 16:19:08.500407 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 212/444] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:08 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:08.561787 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ebc2a182-8679-48ed-ab2f-3b017e1b71f2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:08.563522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ebc2a182-8679-48ed-ab2f-3b017e1b71f2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:08.574677 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ebc2a182-8679-48ed-ab2f-3b017e1b71f2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:08.575206 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ebc2a182-8679-48ed-ab2f-3b017e1b71f2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:08.576121 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ebc2a182-8679-48ed-ab2f-3b017e1b71f2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:08.576608 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ebc2a182-8679-48ed-ab2f-3b017e1b71f2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:08.718546 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ebc2a182-8679-48ed-ab2f-3b017e1b71f2 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163075 Sep 08 16:19:08.721070 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 233/445] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:08 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:09.524034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:09.525192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:09.536395 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:09.536985 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:09.538054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:09.538679 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:09.746254 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a275fc31-b27b-4747-baaf-5a6a6012685c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:09.747834 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a275fc31-b27b-4747-baaf-5a6a6012685c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:09.768853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a275fc31-b27b-4747-baaf-5a6a6012685c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:09.772207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a275fc31-b27b-4747-baaf-5a6a6012685c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:09.778622 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a275fc31-b27b-4747-baaf-5a6a6012685c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:09.781270 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a275fc31-b27b-4747-baaf-5a6a6012685c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:09.995644 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a275fc31-b27b-4747-baaf-5a6a6012685c tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.258488 Sep 08 16:19:10.000222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 234/446] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:09 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:10.031227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:10.049189 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:10.053685 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:10.056250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-51fa6688-a475-4611-a943-5bf77dbceb53 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.540180 Sep 08 16:19:10.057950 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 213/447] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:09 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:11.013648 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-43db72ac-8596-4d6a-b122-72ee4a0a174d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:11.015195 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-43db72ac-8596-4d6a-b122-72ee4a0a174d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:11.030138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43db72ac-8596-4d6a-b122-72ee4a0a174d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:11.031823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43db72ac-8596-4d6a-b122-72ee4a0a174d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:11.034436 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43db72ac-8596-4d6a-b122-72ee4a0a174d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:11.035529 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43db72ac-8596-4d6a-b122-72ee4a0a174d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:11.086293 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:11.087714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:11.096122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:11.096936 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:11.098218 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:11.098338 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:11.186129 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-43db72ac-8596-4d6a-b122-72ee4a0a174d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178734 Sep 08 16:19:11.187224 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 235/448] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:11 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:11.506874 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:11.516682 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:11.518550 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:11.520326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-da034b52-e065-491b-9ee7-e9a2aba5564c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.438550 Sep 08 16:19:11.520886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 214/449] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:11 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:12.208584 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2f790120-eb3d-42a8-a899-0ae9a033f533 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:12.218593 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2f790120-eb3d-42a8-a899-0ae9a033f533 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:12.245074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f790120-eb3d-42a8-a899-0ae9a033f533 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:12.249938 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f790120-eb3d-42a8-a899-0ae9a033f533 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:12.252498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f790120-eb3d-42a8-a899-0ae9a033f533 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:12.257112 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f790120-eb3d-42a8-a899-0ae9a033f533 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:12.421482 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2f790120-eb3d-42a8-a899-0ae9a033f533 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221617 Sep 08 16:19:12.422891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 236/450] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:12 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:12.539878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:12.541208 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:12.554734 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:12.555677 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:12.557169 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:12.557968 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:12.872899 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:12.884129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:12.885881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:12.887063 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-247fa17c-ff7c-4536-9cbd-f1e585baa665 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.351947 Sep 08 16:19:12.887651 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 215/451] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:12 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:13.440095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-425eac8b-1f62-4fa5-bb5b-69ebf4459626 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:13.445055 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-425eac8b-1f62-4fa5-bb5b-69ebf4459626 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:13.463596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-425eac8b-1f62-4fa5-bb5b-69ebf4459626 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:13.464600 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-425eac8b-1f62-4fa5-bb5b-69ebf4459626 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:13.465655 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-425eac8b-1f62-4fa5-bb5b-69ebf4459626 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:13.466616 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-425eac8b-1f62-4fa5-bb5b-69ebf4459626 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:13.627578 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-425eac8b-1f62-4fa5-bb5b-69ebf4459626 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195595 Sep 08 16:19:13.628626 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 237/452] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:13 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:13.908642 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:13.913122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:13.922781 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:13.923682 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:13.924739 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:13.925499 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:14.272086 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:14.299393 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:14.303224 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:14.305559 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-775509d8-3681-40cb-86ad-09488bea5ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.402650 Sep 08 16:19:14.307313 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 216/453] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:13 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:14.642268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-aa495adf-78b4-4193-9f36-885e637a7a6d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:14.643183 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-aa495adf-78b4-4193-9f36-885e637a7a6d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:14.655748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa495adf-78b4-4193-9f36-885e637a7a6d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:14.655748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa495adf-78b4-4193-9f36-885e637a7a6d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:14.656755 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa495adf-78b4-4193-9f36-885e637a7a6d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:14.657302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-aa495adf-78b4-4193-9f36-885e637a7a6d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:14.738214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-aa495adf-78b4-4193-9f36-885e637a7a6d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099776 Sep 08 16:19:14.742068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 238/454] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:14 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:15.025090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-743939395", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:15.126227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] validate_networks() for None {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:19:15.354693 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:15.355843 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:15.379344 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:15.380183 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:15.381204 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:15.381839 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:15.558275 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:19:15.559109 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:19:15.560090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:19:15.560880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:19:15.561701 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:19:15.578245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:15.579621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:15.580823 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:15.581733 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:15.608910 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Getting quotas for project c5959d72d15046548ac7a9dbee8e53f8. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:19:15.626631 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Getting quotas for user a2ed7de999fc4512963ae8278418b402 and project c5959d72d15046548ac7a9dbee8e53f8. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:19:15.661522 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:19:15.664684 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:19:15.762845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5d07adb7-75f9-42f8-93f2-f7fcefe9a8e8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742185 Sep 08 16:19:15.763838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 217/455] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:19:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:19:15.770802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4056f811-37cf-439a-a3df-84d7a54ea47f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:15.772184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4056f811-37cf-439a-a3df-84d7a54ea47f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:15.782089 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4056f811-37cf-439a-a3df-84d7a54ea47f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:15.782849 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4056f811-37cf-439a-a3df-84d7a54ea47f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:15.784070 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4056f811-37cf-439a-a3df-84d7a54ea47f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:15.785239 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4056f811-37cf-439a-a3df-84d7a54ea47f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:15.842124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:15.867221 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:15.870082 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:15.871460 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-72be8ad9-0925-48e1-bcaf-ec0a50e13114 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.538002 Sep 08 16:19:15.872621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 239/456] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:15 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:15.878531 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-137f5ec6-99db-4273-a4cf-a39df51eed8f tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:15.879976 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-137f5ec6-99db-4273-a4cf-a39df51eed8f tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:15.990034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-137f5ec6-99db-4273-a4cf-a39df51eed8f tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:15.998313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-137f5ec6-99db-4273-a4cf-a39df51eed8f tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1214 microversion: 2.1 time: 0.124441 Sep 08 16:19:16.003277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 240/457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:15 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:16.011152 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4056f811-37cf-439a-a3df-84d7a54ea47f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245959 Sep 08 16:19:16.012211 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 218/458] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:15 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:16.913696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:16.914720 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:16.931331 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:16.932168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:16.933891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:16.934867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:17.038839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2c929f94-d967-49be-9544-7be778cbd98f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:17.041976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2c929f94-d967-49be-9544-7be778cbd98f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:17.094067 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c929f94-d967-49be-9544-7be778cbd98f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:17.094929 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c929f94-d967-49be-9544-7be778cbd98f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:17.110418 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c929f94-d967-49be-9544-7be778cbd98f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:17.112094 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c929f94-d967-49be-9544-7be778cbd98f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:17.309519 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2c929f94-d967-49be-9544-7be778cbd98f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.278666 Sep 08 16:19:17.313735 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 219/459] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:17 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:19:17.320399 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:17.321547 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:17.336277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:17.337040 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:17.341317 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:17.342071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:17.411972 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:17.440478 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:17.444748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:17.447604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-448d29ba-85eb-42ca-8a29-24324653ea0a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.545170 Sep 08 16:19:17.460388 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 241/460] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:16 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:17.616998 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:17.635253 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e33c4ad6-0f9e-42ed-924a-ad29f7b73efa tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1218 microversion: 2.1 time: 0.322556 Sep 08 16:19:17.636485 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 220/461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:17 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1218 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:18.328028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-bfbf09b0-152b-420e-b292-a1ab3288ef67 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:18.337070 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-bfbf09b0-152b-420e-b292-a1ab3288ef67 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:18.351533 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bfbf09b0-152b-420e-b292-a1ab3288ef67 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:18.352260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bfbf09b0-152b-420e-b292-a1ab3288ef67 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:18.353539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bfbf09b0-152b-420e-b292-a1ab3288ef67 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:18.354536 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bfbf09b0-152b-420e-b292-a1ab3288ef67 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:18.480563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:18.482102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:18.501171 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:18.501809 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:18.506759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:18.507324 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:18.516053 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-bfbf09b0-152b-420e-b292-a1ab3288ef67 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195127 Sep 08 16:19:18.518285 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 242/462] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:18 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:18.672011 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:18.673812 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:18.684508 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:18.684967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:18.685747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:18.686178 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:18.835698 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:18.864931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9f50e012-f1c5-47dd-8a9b-7ce14082eb22 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1218 microversion: 2.1 time: 0.202151 Sep 08 16:19:18.865534 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 243/463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:18 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1218 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:18.889022 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:18.905568 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:18.908684 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:18.911160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5a3b8678-95bf-4943-8952-6ccfa7e3ae92 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.435745 Sep 08 16:19:18.915553 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 221/464] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:18 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:18.994330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:19:18.994834 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:19:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:19:19.536767 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-505351eb-0a30-4d0d-9760-b659af069c3a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:19.539925 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-505351eb-0a30-4d0d-9760-b659af069c3a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:19.561391 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505351eb-0a30-4d0d-9760-b659af069c3a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:19.561840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505351eb-0a30-4d0d-9760-b659af069c3a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:19.562683 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505351eb-0a30-4d0d-9760-b659af069c3a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:19.563348 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-505351eb-0a30-4d0d-9760-b659af069c3a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:19.637062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-505351eb-0a30-4d0d-9760-b659af069c3a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109951 Sep 08 16:19:19.637646 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 244/465] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:19 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:19:19.884074 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:19.885629 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:19.900132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:19.901144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:19.902760 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:19.903780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:19.947823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:19.949829 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:19.969519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:19.976519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:19.978877 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:19.979296 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:20.173336 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:20.187732 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-71038d8f-c2bb-4403-82d4-c808158dd714 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1218 microversion: 2.1 time: 0.306402 Sep 08 16:19:20.188468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 222/466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:19 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1218 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:20.365060 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:20.386709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:20.389280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:20.390969 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f8a3f1bd-d22a-42ad-bbdc-7f8330b25915 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.459317 Sep 08 16:19:20.391896 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 245/467] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:19 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:20.652822 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8e08f9bc-25fc-46d4-8652-efe0e6552703 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:20.654892 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8e08f9bc-25fc-46d4-8652-efe0e6552703 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:20.707274 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e08f9bc-25fc-46d4-8652-efe0e6552703 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:20.708028 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e08f9bc-25fc-46d4-8652-efe0e6552703 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:20.708881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e08f9bc-25fc-46d4-8652-efe0e6552703 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:20.709320 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e08f9bc-25fc-46d4-8652-efe0e6552703 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:20.818241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8e08f9bc-25fc-46d4-8652-efe0e6552703 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171871 Sep 08 16:19:20.819526 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 223/468] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:20 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:21.225124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:21.226220 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:21.241539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:21.242328 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:21.243749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:21.244376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:21.418845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:21.420058 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:21.438456 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:21.441498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:21.442994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:21.443826 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:21.517868 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:21.564934 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2006ead3-27f3-45b2-b5a7-1d773af716e2 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1266 microversion: 2.1 time: 0.346596 Sep 08 16:19:21.570594 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 246/469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:21 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:21.834195 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a304369d-9392-4704-a5db-fef55c1ea3c7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:21.835133 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a304369d-9392-4704-a5db-fef55c1ea3c7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:21.848850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a304369d-9392-4704-a5db-fef55c1ea3c7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:21.849298 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a304369d-9392-4704-a5db-fef55c1ea3c7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:21.850099 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a304369d-9392-4704-a5db-fef55c1ea3c7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:21.850529 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a304369d-9392-4704-a5db-fef55c1ea3c7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:22.048306 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a304369d-9392-4704-a5db-fef55c1ea3c7 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219017 Sep 08 16:19:22.049197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 247/470] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:21 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:19:22.113991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:22.162052 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:22.171984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:22.195612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cecc407c-3e50-44fb-a1cb-719be6d102e9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.765302 Sep 08 16:19:22.204037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 224/471] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:21 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:22.594739 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:22.596937 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:22.607554 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:22.608305 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:22.609814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:22.610453 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:22.673657 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:22.675289 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:22.684089 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:22.684792 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:22.687275 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:22.688010 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:22.878959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:22.932499 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fac05d7e-12e3-40cf-8875-6b4bea3e8cc8 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1272 microversion: 2.1 time: 0.343835 Sep 08 16:19:22.942506 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 248/472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:22 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1272 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:22.957883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lazy-loading 'services' on Instance uuid 6b41dcee-c75d-451b-a235-a2c3350c0507 {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:19:23.065256 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ac8cd78d-0436-439d-bc9f-2110175cdaaf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:23.067712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ac8cd78d-0436-439d-bc9f-2110175cdaaf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:23.081299 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac8cd78d-0436-439d-bc9f-2110175cdaaf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.082690 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac8cd78d-0436-439d-bc9f-2110175cdaaf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:23.084298 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac8cd78d-0436-439d-bc9f-2110175cdaaf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.085018 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac8cd78d-0436-439d-bc9f-2110175cdaaf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:23.162343 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ac8cd78d-0436-439d-bc9f-2110175cdaaf tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101421 Sep 08 16:19:23.163524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 249/473] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:23 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:23.229698 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:23.230668 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:23.240182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.240621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:23.241651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.242253 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:23.480167 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cbe8c078-3862-4c32-a85b-79b1faba7c80 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments/2346dc78-158e-4d2b-b765-e9ee0f91980d" status: 202 len: 0 microversion: 2.1 time: 0.810685 Sep 08 16:19:23.481782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 225/474] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:19:22 2021] DELETE /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments/2346dc78-158e-4d2b-b765-e9ee0f91980d => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:19:23.493674 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-170ccbc6-faa9-4ee9-b461-9a2c61fefd61 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:23.495358 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-170ccbc6-faa9-4ee9-b461-9a2c61fefd61 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:23.507008 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-170ccbc6-faa9-4ee9-b461-9a2c61fefd61 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.508577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-170ccbc6-faa9-4ee9-b461-9a2c61fefd61 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:23.510064 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-170ccbc6-faa9-4ee9-b461-9a2c61fefd61 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.510980 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-170ccbc6-faa9-4ee9-b461-9a2c61fefd61 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:23.610277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-170ccbc6-faa9-4ee9-b461-9a2c61fefd61 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121120 Sep 08 16:19:23.615610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 226/475] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:23 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:23.624332 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:23.635367 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:23.636825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:23.638212 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0796de24-a811-4021-8c1e-96d099777607 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.413029 Sep 08 16:19:23.639592 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 250/476] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:23 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:23.954283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:23.958745 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:23.968589 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.969133 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:23.970049 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:23.970619 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:24.179902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b8d38e21-3c2d-4daa-add4-3450d9ea0b98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:24.182145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b8d38e21-3c2d-4daa-add4-3450d9ea0b98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:24.196067 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8d38e21-3c2d-4daa-add4-3450d9ea0b98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:24.196800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8d38e21-3c2d-4daa-add4-3450d9ea0b98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:24.197876 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8d38e21-3c2d-4daa-add4-3450d9ea0b98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:24.198456 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8d38e21-3c2d-4daa-add4-3450d9ea0b98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:24.274318 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:24.293161 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-eb101d1a-0baf-438b-b9db-057a1211708b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.345688 Sep 08 16:19:24.294204 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 227/477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:23 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:24.337210 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b8d38e21-3c2d-4daa-add4-3450d9ea0b98 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164727 Sep 08 16:19:24.343590 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 251/478] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:24 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 16:19:24.625245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-af28cf35-cfbb-43c3-9787-df37510bfd76 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:24.626448 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-af28cf35-cfbb-43c3-9787-df37510bfd76 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:24.638856 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-af28cf35-cfbb-43c3-9787-df37510bfd76 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:24.639851 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-af28cf35-cfbb-43c3-9787-df37510bfd76 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:24.641557 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-af28cf35-cfbb-43c3-9787-df37510bfd76 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:24.642676 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-af28cf35-cfbb-43c3-9787-df37510bfd76 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:24.662029 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:24.664435 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:24.680656 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:24.681606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:24.683000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:24.684286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:24.794121 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-af28cf35-cfbb-43c3-9787-df37510bfd76 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173815 Sep 08 16:19:24.796193 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 228/479] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:24 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:25.115414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:25.135103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:25.138797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:25.141171 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1cd2c0ae-50f1-4cc9-82b0-1a4258d035a9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.486093 Sep 08 16:19:25.142293 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 252/480] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:24 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:25.315356 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:25.317696 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:25.330580 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:25.331911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:25.333711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:25.334485 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:25.414660 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-b7908f54-c49e-4cfd-89b6-19123b829f71 req-c5ed0358-c0d5-4acf-8239-1cb54f65ab35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8868bc85-c114-4b48-a7e2-e219903fdd7a", "tag": "803ab228-7f07-46e4-85b7-303bb0d7b118"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:25.417521 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:25.417521 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:19:25.444697 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-b7908f54-c49e-4cfd-89b6-19123b829f71 req-c5ed0358-c0d5-4acf-8239-1cb54f65ab35 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:25.448121 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-b7908f54-c49e-4cfd-89b6-19123b829f71 req-c5ed0358-c0d5-4acf-8239-1cb54f65ab35 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:25.497568 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-b7908f54-c49e-4cfd-89b6-19123b829f71 req-c5ed0358-c0d5-4acf-8239-1cb54f65ab35 service nova] Creating event network-changed:803ab228-7f07-46e4-85b7-303bb0d7b118 for instance 8868bc85-c114-4b48-a7e2-e219903fdd7a on hv-cinder-80789 Sep 08 16:19:25.505955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-b7908f54-c49e-4cfd-89b6-19123b829f71 req-c5ed0358-c0d5-4acf-8239-1cb54f65ab35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110182 Sep 08 16:19:25.506884 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 253/481] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:25.727433 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:25.740173 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-284a1499-8ce6-490e-8d3e-27c509f807c1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.431887 Sep 08 16:19:25.741601 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 229/482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:25 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:25.813078 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1ad6a998-1a13-464f-84be-1a8c59238354 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:25.814755 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1ad6a998-1a13-464f-84be-1a8c59238354 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:25.827504 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1ad6a998-1a13-464f-84be-1a8c59238354 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:25.828252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1ad6a998-1a13-464f-84be-1a8c59238354 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:25.829568 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1ad6a998-1a13-464f-84be-1a8c59238354 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:25.830283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1ad6a998-1a13-464f-84be-1a8c59238354 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:25.976729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1ad6a998-1a13-464f-84be-1a8c59238354 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170865 Sep 08 16:19:25.999958 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 254/483] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:19:25 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 16:19:26.162758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:26.163805 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:26.171817 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:26.172696 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:26.173747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:26.174405 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:26.486273 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:26.497299 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:26.498819 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:26.500019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0511790f-ac0b-44c6-b028-a9399eda8441 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.341892 Sep 08 16:19:26.500594 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 230/484] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:26 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:26.770217 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:26.771114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:26.783652 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:26.784478 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:26.786136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:26.786809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.127942 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:27.144353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-093322ca-4896-4413-b3b3-afd560578530 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.380947 Sep 08 16:19:27.145422 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 255/485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:26 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:27.282224 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:27.283712 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:27.298185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.299113 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.300537 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.301362 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.413807 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:19:27.527073 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:27.529303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:27.544779 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.545440 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.546734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.547446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.610216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-49814268-ae75-442e-a3f0-6e3d4db84c52 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 204 len: 0 microversion: 2.1 time: 0.335225 Sep 08 16:19:27.615569 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 231/486] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:19:27 2021] DELETE /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:27.621606 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:27.622189 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:27.630250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.630732 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.631536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.631957 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.699989 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:19:27.835864 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2667bf81-30c0-4f04-b677-f5a72e0d6246 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 204 len: 0 microversion: 2.1 time: 0.217631 Sep 08 16:19:27.842223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 232/487] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:19:27 2021] DELETE /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:27.852186 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:27.853391 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:27.866540 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.866994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.867516 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:27.867846 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.868295 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.887934 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:27.890711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:27.896596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0299c130-169f-4e14-8d0f-c2a5e89fddcf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.378914 Sep 08 16:19:27.897345 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 256/488] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:27 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:27.904502 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:27.916885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:27.927013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.927801 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:27.928954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:27.929579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:28.341498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:28.351780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7473a5f0-3d95-41ba-8866-74d092ee1a86 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1509 microversion: 2.1 time: 0.507557 Sep 08 16:19:28.352386 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 233/489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:27 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:28.357132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:28.357746 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:28.360344 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:28.367002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:28.367454 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:28.368274 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:28.368714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:28.376325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fc201b89-a23f-413a-ad08-cf1572a739dc tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1513 microversion: 2.1 time: 0.477474 Sep 08 16:19:28.377286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 257/490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:27 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1513 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:28.586577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:28.596017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-bd03effb-5823-46fb-a6b3-9cbb70732a1c tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.242478 Sep 08 16:19:28.596619 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 234/491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:28 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:28.918209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:28.919074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:28.932102 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:28.932623 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:28.933712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:28.934307 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:29.188982 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:29.199016 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:29.200559 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:29.201717 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fcb33c18-c84d-4831-8d18-c4813ef0b1df tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.288215 Sep 08 16:19:29.202289 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 258/492] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:28 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:29.369310 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:29.369959 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:29.378468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:29.379091 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:29.379975 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:29.380418 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:29.394564 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:29.395187 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:29.402954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:29.403399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:29.404235 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:29.404665 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:29.702498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:29.713259 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a3a0ca1c-e56c-46ff-9651-b9abd9ff3453 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1509 microversion: 2.1 time: 0.347600 Sep 08 16:19:29.713777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:29.714025 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 235/493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:29 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:29.718319 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:29.719226 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:29.730815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:29.731068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6ae19258-4e39-4abf-bdc9-78e7b0e9bdba tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1513 microversion: 2.1 time: 0.340384 Sep 08 16:19:29.731615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:29.732052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 259/494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:29 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:29.732938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:29.733726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:29.975755 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:29.984798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7dd5545d-c39b-4f7b-9780-0a4fc76f1d9e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.269615 Sep 08 16:19:29.985387 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 236/495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:29 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:30.220160 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:30.220773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:30.229161 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:30.229610 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:30.230649 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:30.231093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:30.525737 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:30.536894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:30.538703 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:30.540077 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-98339120-f596-4911-bd5a-1a1f786a3649 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.323842 Sep 08 16:19:30.540741 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 260/496] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:30 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:30.740047 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:30.741950 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:30.764773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:30.769970 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:30.771856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:30.777831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:30.784381 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:30.785549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:30.801513 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:30.802534 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:30.804217 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:30.805365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:31.215324 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:31.240032 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3c95421b-20c6-4cdc-98c7-d46854a4202a tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1509 microversion: 2.1 time: 0.507361 Sep 08 16:19:31.246958 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 237/497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:30 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:31.248257 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:31.258474 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:31.259210 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:31.261637 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a5260127-77b2-4275-9c3e-45a0fceec505 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1513 microversion: 2.1 time: 0.500834 Sep 08 16:19:31.262665 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 261/498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:30 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1513 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:31.284018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:31.284361 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:31.285226 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:31.285997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:31.541581 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:31.557929 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f3c1a863-badb-45e2-869b-b39f538ef42b tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.315176 Sep 08 16:19:31.559027 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 238/499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:31 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:31.576149 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:31.577146 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:31.589408 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:31.590357 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:31.592018 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:31.592921 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:32.031906 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:32.046629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:32.048842 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:32.050692 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3f46adb6-df02-4d73-8aad-8185d7942c47 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.487164 Sep 08 16:19:32.051954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 262/500] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:31 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:32.267071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:32.269697 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:32.275975 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-5180f4b5-7547-4206-9f3d-0555c2016ebf req-343a69fa-0a50-4955-a639-de3768e65288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b41dcee-c75d-451b-a235-a2c3350c0507", "name": "network-vif-deleted", "tag": "404552c2-bd69-4d33-bd70-44e44802af54"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:32.279446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:32.279446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:19:32.291077 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:32.293950 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:32.296977 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:32.298476 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:32.300716 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-5180f4b5-7547-4206-9f3d-0555c2016ebf req-343a69fa-0a50-4955-a639-de3768e65288 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:32.301770 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-5180f4b5-7547-4206-9f3d-0555c2016ebf req-343a69fa-0a50-4955-a639-de3768e65288 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:32.359087 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-5180f4b5-7547-4206-9f3d-0555c2016ebf req-343a69fa-0a50-4955-a639-de3768e65288 service nova] Creating event network-vif-deleted:404552c2-bd69-4d33-bd70-44e44802af54 for instance 6b41dcee-c75d-451b-a235-a2c3350c0507 on hv-cinder-80789 Sep 08 16:19:32.373876 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-5180f4b5-7547-4206-9f3d-0555c2016ebf req-343a69fa-0a50-4955-a639-de3768e65288 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105124 Sep 08 16:19:32.375127 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 263/501] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:19:32.383300 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:32.384246 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:32.434717 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:32.435908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:32.437509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:32.441641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:32.888465 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:32.908283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cf7a50e3-9d92-4f43-9d86-b157bd3a7ef5 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1509 microversion: 2.1 time: 0.651752 Sep 08 16:19:32.924352 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 239/502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:32 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1509 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:32.957554 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:32.958089 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:32.973002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:32.975139 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:32.978393 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:32.979354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:33.014574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:33.026106 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b427b5b9-2fd6-4f15-b1ae-3ff266d7d287 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 200 len: 1302 microversion: 2.1 time: 0.648673 Sep 08 16:19:33.039531 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 264/503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:32 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 1302 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:33.079618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:33.080073 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:33.089486 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:33.089932 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:33.090716 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:33.091148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:33.392847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:33.403865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-198930a9-2607-4730-8bac-6079d3c0d894 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.474071 Sep 08 16:19:33.404739 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 240/504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:32 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:33.492373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:33.503429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:33.505054 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:33.506462 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5d0b48bf-6d38-4032-ad1d-7f1711ff8065 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.430679 Sep 08 16:19:33.507037 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 265/505] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:33 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:33.935872 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:33.936830 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:33.961730 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:33.962601 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:33.963808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:33.965548 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.077365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:34.078177 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 6b41dcee-c75d-451b-a235-a2c3350c0507] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:34.089865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.090329 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.091147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.091612 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.099688 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.100133 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.100607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lazy-loading 'fault' on Instance uuid ccdab9af-f621-453f-9905-a59a53ee671c {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:19:34.147801 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] HTTP exception thrown: Instance 6b41dcee-c75d-451b-a235-a2c3350c0507 could not be found. Sep 08 16:19:34.148412 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Returning 404 to user: Instance 6b41dcee-c75d-451b-a235-a2c3350c0507 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:19:34.149320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f69bf4bd-dbe7-4e8b-81d2-5ac5d2f37391 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507" status: 404 len: 111 microversion: 2.1 time: 0.081321 Sep 08 16:19:34.150176 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 266/506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:34 2021] GET /compute/v2.1/servers/6b41dcee-c75d-451b-a235-a2c3350c0507 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:19:34.186160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:34.202729 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a281fdcb-1673-40ec-a3d6-47402aeac850 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 200 len: 1312 microversion: 2.1 time: 0.270830 Sep 08 16:19:34.203949 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 241/507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:33 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:34.399783 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-b88012db-2323-4146-a7d4-8408f52c95a5 req-758cef13-78b1-42bf-9a94-1f10b251b58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccdab9af-f621-453f-9905-a59a53ee671c", "name": "network-vif-deleted", "tag": "78b9175d-18a8-472a-b285-f0a5f252604e"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:34.401948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:34.401948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:19:34.412519 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-b88012db-2323-4146-a7d4-8408f52c95a5 req-758cef13-78b1-42bf-9a94-1f10b251b58f service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.413340 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-b88012db-2323-4146-a7d4-8408f52c95a5 req-758cef13-78b1-42bf-9a94-1f10b251b58f service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.434684 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-b88012db-2323-4146-a7d4-8408f52c95a5 req-758cef13-78b1-42bf-9a94-1f10b251b58f service nova] Creating event network-vif-deleted:78b9175d-18a8-472a-b285-f0a5f252604e for instance ccdab9af-f621-453f-9905-a59a53ee671c on hv-cinder-80789 Sep 08 16:19:34.438292 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:34.441681 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-b88012db-2323-4146-a7d4-8408f52c95a5 req-758cef13-78b1-42bf-9a94-1f10b251b58f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050766 Sep 08 16:19:34.441923 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:34.442790 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 267/508] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:34.451922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.452481 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.453385 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.453908 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.527140 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:34.528074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:34.537742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.538617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.539734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:34.540471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:34.937441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:34.941503 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:34.973216 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:34.974038 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7dbd9d6a-ea25-4ead-8318-c6c993d107ad tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.546131 Sep 08 16:19:34.975151 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 242/509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:34 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:34.978604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:34.980873 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f2560e01-8225-4496-b7cb-6339b33bf5ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.457890 Sep 08 16:19:34.982905 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 268/510] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:34 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:34.986002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-524cccbd-ad49-400c-8ff9-6cd7f57c8d16 req-e8534352-ded1-40b8-a87d-00e7470a247e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dd36a3-a4b2-4d0e-8140-e629d0c9954d", "name": "network-vif-plugged", "status": "completed", "tag": "625c811b-4427-4c32-9c2e-61a56adb42db"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:34.990285 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:34.990285 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:19:35.006611 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-524cccbd-ad49-400c-8ff9-6cd7f57c8d16 req-e8534352-ded1-40b8-a87d-00e7470a247e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.007636 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-524cccbd-ad49-400c-8ff9-6cd7f57c8d16 req-e8534352-ded1-40b8-a87d-00e7470a247e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.030837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-524cccbd-ad49-400c-8ff9-6cd7f57c8d16 req-e8534352-ded1-40b8-a87d-00e7470a247e service nova] Creating event network-vif-plugged:625c811b-4427-4c32-9c2e-61a56adb42db for instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d on hv-cinder-80789 Sep 08 16:19:35.038127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-524cccbd-ad49-400c-8ff9-6cd7f57c8d16 req-e8534352-ded1-40b8-a87d-00e7470a247e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059218 Sep 08 16:19:35.039263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 243/511] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:35.221119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:35.223147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: ccdab9af-f621-453f-9905-a59a53ee671c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:35.243068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.243952 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.245377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.246303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.343899 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] HTTP exception thrown: Instance ccdab9af-f621-453f-9905-a59a53ee671c could not be found. Sep 08 16:19:35.344673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Returning 404 to user: Instance ccdab9af-f621-453f-9905-a59a53ee671c could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:19:35.345902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-67dbd94f-c133-457c-96c2-de9d569bfb09 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c" status: 404 len: 111 microversion: 2.1 time: 0.129420 Sep 08 16:19:35.347105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 269/512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:35 2021] GET /compute/v2.1/servers/ccdab9af-f621-453f-9905-a59a53ee671c => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:19:35.361382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:35.362660 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:35.377136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.378051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.380406 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.381028 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.442642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:35.443824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:35.458607 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.459803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.460915 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.461709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.481474 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:19:35.542946 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:19:35.694092 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7e213cb0-e852-4d65-8277-c9cc4575f87d tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 204 len: 0 microversion: 2.1 time: 0.339504 Sep 08 16:19:35.698442 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 244/513] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:19:35 2021] DELETE /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:35.715563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:35.716960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:35.726708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-20676586-27ce-4511-8cf6-39cb5cb5a67c tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 204 len: 0 microversion: 2.1 time: 0.291250 Sep 08 16:19:35.727729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 270/514] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:19:35 2021] DELETE /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:35.735934 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.736719 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.737994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.738951 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.739220 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:35.739957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:35.748642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.749062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:35.749853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:35.750283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:36.114836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:36.124051 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a628c35d-3000-4098-bbcb-ee1289da8a9e tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1514 microversion: 2.1 time: 0.390281 Sep 08 16:19:36.124739 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 271/515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:35 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:36.129977 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:36.130673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:36.131929 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:36.138563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:36.139004 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:36.140373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:36.140373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:36.149177 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5b635531-71b4-4fdd-9ed2-99755af6786f tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.443271 Sep 08 16:19:36.150869 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 245/516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:35 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:36.161636 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:36.162806 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:36.178967 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:36.179422 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:36.180535 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:36.181015 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:36.516871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:36.528908 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:36.529760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:36.530983 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:36.532236 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fc591b35-cc22-4feb-8594-08d6333f2dde tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.406456 Sep 08 16:19:36.532797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 272/517] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:36 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:36.542998 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d9c3cb28-8e8a-4483-93cb-0a930a53e7f1 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.390445 Sep 08 16:19:36.544143 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 246/518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:36 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:37.054516 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-7a154b1c-a80b-4dd7-a23c-320b9a23ef48 req-eb7b6b60-033a-434b-a792-38fc129e425c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8868bc85-c114-4b48-a7e2-e219903fdd7a", "name": "network-vif-plugged", "status": "completed", "tag": "803ab228-7f07-46e4-85b7-303bb0d7b118"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:37.056141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:37.056141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:19:37.064908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7a154b1c-a80b-4dd7-a23c-320b9a23ef48 req-eb7b6b60-033a-434b-a792-38fc129e425c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.065931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7a154b1c-a80b-4dd7-a23c-320b9a23ef48 req-eb7b6b60-033a-434b-a792-38fc129e425c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.085458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-7a154b1c-a80b-4dd7-a23c-320b9a23ef48 req-eb7b6b60-033a-434b-a792-38fc129e425c service nova] Creating event network-vif-plugged:803ab228-7f07-46e4-85b7-303bb0d7b118 for instance 8868bc85-c114-4b48-a7e2-e219903fdd7a on hv-cinder-80789 Sep 08 16:19:37.092072 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-7a154b1c-a80b-4dd7-a23c-320b9a23ef48 req-eb7b6b60-033a-434b-a792-38fc129e425c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041698 Sep 08 16:19:37.093409 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 273/519] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:19:37.151718 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:37.152621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:37.163396 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.164021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.165196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.165952 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.177955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:37.179204 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:37.189481 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.189893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.190744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.191243 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.515219 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:37.530220 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1824ad2c-66e7-4f0f-b081-f186bcf0db41 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1514 microversion: 2.1 time: 0.382676 Sep 08 16:19:37.531177 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 247/520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:37 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:37.553113 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:37.554108 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:37.582476 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.583251 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.584294 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.586491 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.590796 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:37.614692 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-06247104-6293-4d94-abde-e979952a0423 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.443505 Sep 08 16:19:37.616604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 274/521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:37 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:37.628877 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:37.629058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:37.644705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.646043 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:37.648090 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:37.649358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:38.064696 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:38.076225 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:38.077901 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:38.079327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8b49748d-3430-4651-a5ed-9137982261fa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1807 microversion: 2.20 time: 0.531362 Sep 08 16:19:38.080398 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 248/522] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:37 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1807 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:19:38.086952 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:38.096130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c31915ab-dd3d-4f7f-910e-22d96d999741 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.475122 Sep 08 16:19:38.097272 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 275/523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:37 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:38.550370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:38.552323 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:38.561127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:38.561885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:38.562761 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:38.563376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:38.658660 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:38.660953 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:38.670836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:38.671499 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:38.672421 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:38.672992 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:38.951639 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:38.963906 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8c07aec1-8058-4c07-889a-2b1bfa14d0c9 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1514 microversion: 2.1 time: 0.418158 Sep 08 16:19:38.964637 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 249/524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:38 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1514 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:39.048870 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:39.059786 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4b4de0b2-add9-4750-8151-76c33fe89664 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.407222 Sep 08 16:19:39.060379 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 276/525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:38 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:39.108912 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:39.109947 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:39.114738 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:39.115631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:39.119020 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:39.119557 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:39.120419 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:39.121122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:39.124951 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:39.125523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:39.126438 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:39.126975 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:39.640543 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:39.648797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:39.656897 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:39.658509 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:39.659844 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0ab1dd88-8e10-413e-aa2a-42805c18b25a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1794 microversion: 2.20 time: 0.555126 Sep 08 16:19:39.660801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 250/526] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:19:39 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1794 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:19:39.676793 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-abb0dd2e-c0cc-43c1-ad92-96219356199a tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1314 microversion: 2.1 time: 0.565999 Sep 08 16:19:39.677575 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 277/527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:39 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:39.984179 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:39.986567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:39.999515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:39.999836 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:40.000687 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:40.001145 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:40.083260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:40.084129 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:40.091999 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:40.092545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:40.093455 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:40.093959 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:40.310242 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:40.327694 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7be8e765-9d7b-48d6-b467-3600adbb9dc1 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1514 microversion: 2.1 time: 0.348393 Sep 08 16:19:40.329570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 251/528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:39 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:40.377092 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-220b1cf9-3963-4d10-b9ae-2dd7c31d0663 req-6c5f17c3-1915-4c85-bbf3-6dd11302ada7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c08f6f9-7669-40ee-b76b-b418d405c6fd", "name": "network-vif-deleted", "tag": "e918380a-f380-42f2-a078-3ebb80ee7526"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:40.381057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:40.381057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:19:40.395778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-220b1cf9-3963-4d10-b9ae-2dd7c31d0663 req-6c5f17c3-1915-4c85-bbf3-6dd11302ada7 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:40.396645 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-220b1cf9-3963-4d10-b9ae-2dd7c31d0663 req-6c5f17c3-1915-4c85-bbf3-6dd11302ada7 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:40.397364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:40.414025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4db81191-e77a-4ec5-84bb-1eba8b82dc57 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.339940 Sep 08 16:19:40.417499 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 278/529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:40 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:40.430663 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-220b1cf9-3963-4d10-b9ae-2dd7c31d0663 req-6c5f17c3-1915-4c85-bbf3-6dd11302ada7 service nova] Creating event network-vif-deleted:e918380a-f380-42f2-a078-3ebb80ee7526 for instance 8c08f6f9-7669-40ee-b76b-b418d405c6fd on hv-cinder-80789 Sep 08 16:19:40.439254 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-220b1cf9-3963-4d10-b9ae-2dd7c31d0663 req-6c5f17c3-1915-4c85-bbf3-6dd11302ada7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067882 Sep 08 16:19:40.440604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 252/530] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:40.694926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:40.695813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:40.703775 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:40.704225 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:40.705028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:40.705471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:40.935705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:40.953280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-cc4593c7-3af6-4dcb-b65c-1183667dacaf tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1463 microversion: 2.1 time: 0.261846 Sep 08 16:19:40.954353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 279/531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:40 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1463 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:41.029321 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:41.029983 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:41.039841 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.040297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.041092 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.041585 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.130497 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:19:41.328093 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f5b3ccd4-236a-41d6-87a4-30de8d9b2e16 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 204 len: 0 microversion: 2.1 time: 0.302259 Sep 08 16:19:41.329909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 253/532] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:19:41 2021] DELETE /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:41.342652 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:41.344401 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:41.349213 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:41.350021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:41.356057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.356683 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.357972 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.358640 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.359768 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.360287 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.361143 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.361640 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.445811 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.446301 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.446675 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lazy-loading 'fault' on Instance uuid 8c08f6f9-7669-40ee-b76b-b418d405c6fd {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:19:41.551135 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:41.567922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9f4e794a-c220-486f-b160-838974dbd709 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 200 len: 1308 microversion: 2.1 time: 0.224391 Sep 08 16:19:41.569005 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 254/533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:41 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:41.577098 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:41.577995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:41.589302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.589824 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.590571 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:41.591005 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:41.663838 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:41.675007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d08215f3-fafe-4109-a572-62e3c4204a00 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1469 microversion: 2.1 time: 0.339014 Sep 08 16:19:41.676502 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 280/534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:41 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:41.824917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:41.833915 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-23c11822-f453-4679-987d-73ba695a11a0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.263346 Sep 08 16:19:41.834508 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 255/535] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:41 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:42.590490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:42.591083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 8c08f6f9-7669-40ee-b76b-b418d405c6fd] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:42.598831 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.599277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:42.600139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.600568 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:42.656037 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] HTTP exception thrown: Instance 8c08f6f9-7669-40ee-b76b-b418d405c6fd could not be found. Sep 08 16:19:42.656641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Returning 404 to user: Instance 8c08f6f9-7669-40ee-b76b-b418d405c6fd could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:19:42.657511 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9c192737-c0de-44ea-a888-e298e30aa784 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd" status: 404 len: 111 microversion: 2.1 time: 0.070977 Sep 08 16:19:42.658067 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 281/536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:42 2021] GET /compute/v2.1/servers/8c08f6f9-7669-40ee-b76b-b418d405c6fd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:19:42.666847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:42.667567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:42.675319 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.675931 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:42.676776 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.677329 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:42.696135 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:42.696910 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:42.705452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.706871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:42.707956 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.708453 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:42.742943 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:19:42.902091 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-35d9a547-6ee8-42d7-bef9-11adc3376efb tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "DELETE /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 204 len: 0 microversion: 2.1 time: 0.237797 Sep 08 16:19:42.903906 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 256/537] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:19:42 2021] DELETE /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:42.916633 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:42.918211 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:42.934496 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.935459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:42.937241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:42.938135 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:43.007013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:43.016225 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-54eab19d-621e-49ab-97a5-5243fe055886 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1469 microversion: 2.1 time: 0.324297 Sep 08 16:19:43.016814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 282/538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:42 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:43.022195 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:43.022866 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:43.030941 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:43.031392 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:43.032440 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:43.032893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:43.301763 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:43.312436 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d0239ca3-74dd-4879-812b-0460f6066555 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.406141 Sep 08 16:19:43.313229 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 257/539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:42 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:43.324513 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:43.334241 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-70779470-91c7-4e68-90dc-3a3b924adf9a tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1513 microversion: 2.1 time: 0.316306 Sep 08 16:19:43.334846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 283/540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:43 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1513 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:44.045726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:44.046858 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:44.060974 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:44.061796 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:44.063236 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:44.063966 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:44.321305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:44.334709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:44.335782 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:44.340143 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-be5283f9-e4f5-46ae-8d4b-986b12f8082e tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1469 microversion: 2.1 time: 0.300489 Sep 08 16:19:44.347200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 258/541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:44 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:44.352505 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:44.353418 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:44.354912 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:44.355729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:44.367386 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:44.368463 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:44.383548 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:44.384309 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:44.385691 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:44.386464 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:44.818799 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:44.825388 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:44.834496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7d77b322-84b7-474b-be94-a14d1754f7b0 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.507185 Sep 08 16:19:44.835554 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 284/542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:44 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:44.840317 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-77edb14a-e2ba-411d-85d2-da307863a3e2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1513 microversion: 2.1 time: 0.484263 Sep 08 16:19:44.845703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 259/543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:44 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1513 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:45.369543 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:45.370444 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:45.384431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:45.384893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:45.385700 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:45.386838 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:45.529147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:45.544583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-bf09ed92-5ef3-470a-a851-3bed86d7c962 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1427 microversion: 2.1 time: 0.175807 Sep 08 16:19:45.557015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 285/544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:45 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:45.677875 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-65f8388a-59b7-4ae3-9496-6d61de8416c8 req-fb22b675-4463-45a7-bb25-c51976846bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8868bc85-c114-4b48-a7e2-e219903fdd7a", "name": "network-vif-deleted", "tag": "803ab228-7f07-46e4-85b7-303bb0d7b118"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:45.681256 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:45.681256 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:19:45.697174 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-65f8388a-59b7-4ae3-9496-6d61de8416c8 req-fb22b675-4463-45a7-bb25-c51976846bd0 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:45.698694 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-65f8388a-59b7-4ae3-9496-6d61de8416c8 req-fb22b675-4463-45a7-bb25-c51976846bd0 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:45.855711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:45.856694 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:45.887970 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:45.889135 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:45.890948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:45.892046 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:45.929344 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-65f8388a-59b7-4ae3-9496-6d61de8416c8 req-fb22b675-4463-45a7-bb25-c51976846bd0 service nova] Creating event network-vif-deleted:803ab228-7f07-46e4-85b7-303bb0d7b118 for instance 8868bc85-c114-4b48-a7e2-e219903fdd7a on hv-cinder-80789 Sep 08 16:19:45.938906 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-65f8388a-59b7-4ae3-9496-6d61de8416c8 req-fb22b675-4463-45a7-bb25-c51976846bd0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272549 Sep 08 16:19:45.940719 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 260/545] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:45.947330 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:45.948449 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:45.957569 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:45.958405 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:45.959410 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:45.960118 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:46.369123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:46.386394 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-010b10e7-c824-4799-912e-b266422d6879 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1513 microversion: 2.1 time: 0.443213 Sep 08 16:19:46.387877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 261/546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:45 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1513 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:46.464782 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:46.487624 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f3559c97-6fda-49f8-9536-aabf34014054 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.637759 Sep 08 16:19:46.491747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 286/547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:45 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:46.574320 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:46.575220 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:46.583277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:46.583985 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:46.584550 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:46.584985 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:46.735041 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:46.736101 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:46.737449 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lazy-loading 'fault' on Instance uuid 8868bc85-c114-4b48-a7e2-e219903fdd7a {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:19:46.840716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2ed7de999fc4512963ae8278418b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5959d72d15046548ac7a9dbee8e53f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:46.850155 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c50241ed-5964-487e-8086-2776114ebab5 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 200 len: 1304 microversion: 2.1 time: 0.282205 Sep 08 16:19:46.850919 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 262/548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:46 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 1304 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:47.409940 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:47.411311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:47.426132 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:47.427177 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:47.428984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:47.429833 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:47.515526 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:47.515526 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:47.529722 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:47.530540 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:47.532019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:47.532821 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:47.909459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:47.944494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-244faeca-f9a5-48c8-a3bc-39ec433de727 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1471 microversion: 2.1 time: 0.542407 Sep 08 16:19:47.945483 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 287/549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:47 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:47.965006 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:47.976768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] [instance: 8868bc85-c114-4b48-a7e2-e219903fdd7a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:47.996926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:47.998166 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:47.999870 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:48.001885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:48.096652 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:48.118704 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a9756ac1-913c-45b9-9500-4b4b3667162b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1522 microversion: 2.1 time: 0.615252 Sep 08 16:19:48.133739 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 263/550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:47 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:48.136350 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] HTTP exception thrown: Instance 8868bc85-c114-4b48-a7e2-e219903fdd7a could not be found. Sep 08 16:19:48.137471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] Returning 404 to user: Instance 8868bc85-c114-4b48-a7e2-e219903fdd7a could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:19:48.139202 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ed37d809-03e0-42f5-9a28-be6566a5c1f0 tempest-VolumesNegativeTest-910650147 tempest-VolumesNegativeTest-910650147-project] 10.222.0.25 "GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a" status: 404 len: 111 microversion: 2.1 time: 0.190461 Sep 08 16:19:48.140532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 288/551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:47 2021] GET /compute/v2.1/servers/8868bc85-c114-4b48-a7e2-e219903fdd7a => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:19:48.145225 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-b0595e8c-edba-440d-8721-d43eb5f729de req-3acf443a-aa67-475f-b60e-d6e524a52abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e52b75-f414-4602-9e4a-b937e7875135", "name": "network-vif-deleted", "tag": "aa473e45-2d44-4f49-a4fd-95423bbd6c8d"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:48.148912 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:48.148912 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:19:48.168338 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-b0595e8c-edba-440d-8721-d43eb5f729de req-3acf443a-aa67-475f-b60e-d6e524a52abe service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:48.169645 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-b0595e8c-edba-440d-8721-d43eb5f729de req-3acf443a-aa67-475f-b60e-d6e524a52abe service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:48.207245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-b0595e8c-edba-440d-8721-d43eb5f729de req-3acf443a-aa67-475f-b60e-d6e524a52abe service nova] Creating event network-vif-deleted:aa473e45-2d44-4f49-a4fd-95423bbd6c8d for instance 97e52b75-f414-4602-9e4a-b937e7875135 on hv-cinder-80789 Sep 08 16:19:48.218178 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-b0595e8c-edba-440d-8721-d43eb5f729de req-3acf443a-aa67-475f-b60e-d6e524a52abe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081230 Sep 08 16:19:48.219970 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 264/552] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:48.971612 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:48.974626 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:48.993013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:48.993751 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:48.995036 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:48.995819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:49.132229 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:49.132982 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:49.133779 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lazy-loading 'fault' on Instance uuid 97e52b75-f414-4602-9e4a-b937e7875135 {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:19:49.141339 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:49.143272 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:49.153169 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:49.153619 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:49.155514 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:49.156371 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:49.223587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:49.237861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8790dda4-8e3d-49d1-9835-01d46bee2664 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 200 len: 1308 microversion: 2.1 time: 0.277365 Sep 08 16:19:49.239593 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 289/553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:48 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:49.329859 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:49.330999 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:49.331606 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lazy-loading 'fault' on Instance uuid 025be250-ed13-4171-af63-942ce76ab60a {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:19:49.428566 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f125cc545a40929c6bfa8997ccd041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abc28c3a0c44587b1e4367f9363241d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:49.438538 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d06ba4bc-7feb-4fec-948d-411191d6cd1b tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 200 len: 1312 microversion: 2.1 time: 0.301241 Sep 08 16:19:49.439272 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 265/554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:49 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:19:50.239700 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-7b9f292c-76cd-4146-9d80-2297b3fca49d req-01551d11-ae29-4c58-a0d5-61b8dc9518d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025be250-ed13-4171-af63-942ce76ab60a", "name": "network-vif-deleted", "tag": "59e7e543-15da-4662-9f0c-ec72acd13a77"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:50.242105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:50.242105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:19:50.255987 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7b9f292c-76cd-4146-9d80-2297b3fca49d req-01551d11-ae29-4c58-a0d5-61b8dc9518d6 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:50.256653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7b9f292c-76cd-4146-9d80-2297b3fca49d req-01551d11-ae29-4c58-a0d5-61b8dc9518d6 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:50.267235 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:50.268716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 97e52b75-f414-4602-9e4a-b937e7875135] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:50.278957 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:50.279795 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:50.280803 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:50.281426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:50.286781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-7b9f292c-76cd-4146-9d80-2297b3fca49d req-01551d11-ae29-4c58-a0d5-61b8dc9518d6 service nova] Creating event network-vif-deleted:59e7e543-15da-4662-9f0c-ec72acd13a77 for instance 025be250-ed13-4171-af63-942ce76ab60a on hv-cinder-80789 Sep 08 16:19:50.293488 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-7b9f292c-76cd-4146-9d80-2297b3fca49d req-01551d11-ae29-4c58-a0d5-61b8dc9518d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059059 Sep 08 16:19:50.294428 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 290/555] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:50.365415 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] HTTP exception thrown: Instance 97e52b75-f414-4602-9e4a-b937e7875135 could not be found. Sep 08 16:19:50.366119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Returning 404 to user: Instance 97e52b75-f414-4602-9e4a-b937e7875135 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:19:50.366902 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-46b605ac-19e6-41ce-a1b1-ee5077b91bd6 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135" status: 404 len: 111 microversion: 2.1 time: 0.105134 Sep 08 16:19:50.367552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 266/556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:50 2021] GET /compute/v2.1/servers/97e52b75-f414-4602-9e4a-b937e7875135 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:19:50.467049 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:50.469366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] [instance: 025be250-ed13-4171-af63-942ce76ab60a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:50.495735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:50.496658 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:50.497707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:50.498419 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:50.575634 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] HTTP exception thrown: Instance 025be250-ed13-4171-af63-942ce76ab60a could not be found. Sep 08 16:19:50.576713 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] Returning 404 to user: Instance 025be250-ed13-4171-af63-942ce76ab60a could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:19:50.578228 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-42b1ab2e-72dd-4d0b-85f1-b1b3cbc0ed13 tempest-ServerRescueNegativeTestJSON-317125560 tempest-ServerRescueNegativeTestJSON-317125560-project] 10.222.0.25 "GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a" status: 404 len: 111 microversion: 2.1 time: 0.117769 Sep 08 16:19:50.579577 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 291/557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:50 2021] GET /compute/v2.1/servers/025be250-ed13-4171-af63-942ce76ab60a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:19:53.375514 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:53.376019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:53.385374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:53.387426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:53.388383 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:53.388832 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:53.572214 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lazy-loading 'services' on Instance uuid 3db24e43-208d-4d9e-a75c-98f3168ab156 {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:19:53.727218 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-dbb5377e-52a3-49a6-a6f5-a53491d4af57 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-volume_attachments/0bd72157-f853-4245-992f-f73b97436680" status: 202 len: 0 microversion: 2.1 time: 0.355350 Sep 08 16:19:53.727942 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 267/558] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:19:53 2021] DELETE /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-volume_attachments/0bd72157-f853-4245-992f-f73b97436680 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:19:54.069885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:54.071422 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:54.079880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:54.081460 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:54.082428 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:54.082929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:54.170313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:19:54.398686 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-73dc0ac2-27df-4a69-9835-1cc1055ce364 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 204 len: 0 microversion: 2.1 time: 0.336297 Sep 08 16:19:54.399350 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 292/559] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:19:54 2021] DELETE /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:54.417007 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:54.419212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:54.480374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:54.483543 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:54.487401 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:54.488782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:55.403221 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:55.415316 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ba4bdf93-1103-4538-9840-cd4d4101d2a2 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1513 microversion: 2.1 time: 1.008613 Sep 08 16:19:55.417855 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 268/560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:54 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1513 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:56.448400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:56.449621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:56.462805 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:56.463596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:56.464861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:56.465581 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:56.853899 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:56.887059 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c90087e7-d6fa-4fd7-b405-adeedb40d717 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1513 microversion: 2.1 time: 0.445226 Sep 08 16:19:56.888864 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 293/561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:56 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:57.927433 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:57.935101 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:57.973307 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:57.979933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:57.982370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:57.985261 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:58.096317 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-090b5366-bd4f-4b2c-b0db-9081790dc242 req-5ad9e635-bb40-41c1-b0be-d2bbf53e4615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5667d820-d623-4b13-af5f-cee38599c046", "name": "network-vif-deleted", "tag": "7cbd5dee-f58a-4b80-ad1f-8953c26b4057"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:58.097928 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:19:58.097928 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:19:58.115911 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-090b5366-bd4f-4b2c-b0db-9081790dc242 req-5ad9e635-bb40-41c1-b0be-d2bbf53e4615 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:58.117449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-090b5366-bd4f-4b2c-b0db-9081790dc242 req-5ad9e635-bb40-41c1-b0be-d2bbf53e4615 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:58.150222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-090b5366-bd4f-4b2c-b0db-9081790dc242 req-5ad9e635-bb40-41c1-b0be-d2bbf53e4615 service nova] Creating event network-vif-deleted:7cbd5dee-f58a-4b80-ad1f-8953c26b4057 for instance 5667d820-d623-4b13-af5f-cee38599c046 on hv-cinder-80789 Sep 08 16:19:58.156642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-090b5366-bd4f-4b2c-b0db-9081790dc242 req-5ad9e635-bb40-41c1-b0be-d2bbf53e4615 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063982 Sep 08 16:19:58.159923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 294/562] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:58.295102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7beb1f9356b8445ebaaf7a422a8aad6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c774bb92304c42ab3c6d7f2ab7e7dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:58.307326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-74ead28e-77a6-4e67-bdf3-63725bf45b2b tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 200 len: 1471 microversion: 2.1 time: 0.395139 Sep 08 16:19:58.308083 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 269/563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:57 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 1471 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:59.328575 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:59.329790 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] [instance: 5667d820-d623-4b13-af5f-cee38599c046] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:19:59.345178 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:59.346452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:59.348104 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:19:59.349093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:19:59.445588 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] HTTP exception thrown: Instance 5667d820-d623-4b13-af5f-cee38599c046 could not be found. Sep 08 16:19:59.446656 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] Returning 404 to user: Instance 5667d820-d623-4b13-af5f-cee38599c046 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:19:59.448090 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8478c82a-e12c-49e4-85b1-19267a5c1f19 tempest-AttachVolumeNegativeTest-1547511260 tempest-AttachVolumeNegativeTest-1547511260-project] 10.222.0.25 "GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046" status: 404 len: 111 microversion: 2.1 time: 0.125666 Sep 08 16:19:59.449944 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 295/564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:19:59 2021] GET /compute/v2.1/servers/5667d820-d623-4b13-af5f-cee38599c046 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:20:00.958377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b2808f76-432a-433a-9d2b-b680d162e979 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:00.973078 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b2808f76-432a-433a-9d2b-b680d162e979 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:00.973529 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b2808f76-432a-433a-9d2b-b680d162e979 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:01.102872 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b2808f76-432a-433a-9d2b-b680d162e979 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Going to try to stop instance {{(pid=93617) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Sep 08 16:20:01.198404 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b2808f76-432a-433a-9d2b-b680d162e979 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 202 len: 0 microversion: 2.1 time: 0.246425 Sep 08 16:20:01.199159 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 270/565] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:20:00 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:20:01.213400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:01.215683 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:01.231914 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:01.233056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:01.235118 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:01.236350 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:01.551325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:01.567395 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-66b0fca9-3ec4-4bcb-9e06-baa02a0e2c6c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.363200 Sep 08 16:20:01.568410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 296/566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:01 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:02.178865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cde3235a-fc15-42f5-a8f8-c0af42919528 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f3704777310>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:02.322940 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cde3235a-fc15-42f5-a8f8-c0af42919528 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ab1fd4c3-dd74-4ed5-b860-08fa258b71ec" status: 200 len: 350 microversion: 2.1 time: 0.149171 Sep 08 16:20:02.324146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 271/567] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:20:02 2021] GET /compute/v2.1/os-volumes/ab1fd4c3-dd74-4ed5-b860-08fa258b71ec => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:02.589713 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:02.590252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:02.599167 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:02.600012 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:02.601293 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:02.602008 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:02.981803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:03.012459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-171ca369-89f0-47ee-90b0-70f99340a643 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.423837 Sep 08 16:20:03.013678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 297/568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:02 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:04.044498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:04.045889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:04.055252 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:04.056177 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:04.057121 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:04.057642 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:04.252586 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-520f3ac4-72ac-48af-b47e-797b8320e06a tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f37046ae9d0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:04.409427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-520f3ac4-72ac-48af-b47e-797b8320e06a tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1657e365-b2cf-4971-a67e-dcd35cf29e49" status: 200 len: 350 microversion: 2.1 time: 0.163436 Sep 08 16:20:04.411356 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 298/569] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:20:04 2021] GET /compute/v2.1/os-volumes/1657e365-b2cf-4971-a67e-dcd35cf29e49 => generated 350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:20:04.485662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:04.499531 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-43aac293-424f-4f7a-9206-4c181e9a2d1c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.458544 Sep 08 16:20:04.500778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 272/570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:04 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:05.529400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:05.530429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:05.540892 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:05.542158 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:05.543289 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:05.544039 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:05.880915 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:05.900309 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fd93f028-b65e-4f96-8f3a-9fb08a277e51 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.374689 Sep 08 16:20:05.901887 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 299/571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:05 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:06.434764 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-acbf2673-c75a-40b3-9cc6-cabd6f72ca9e tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f3704747940>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:06.537547 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-acbf2673-c75a-40b3-9cc6-cabd6f72ca9e tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0e146a68-7ecf-4228-88b3-1397997abc9f" status: 200 len: 351 microversion: 2.1 time: 0.107147 Sep 08 16:20:06.538127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 273/572] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Sep 8 16:20:06 2021] GET /compute/v2.1/os-volumes/0e146a68-7ecf-4228-88b3-1397997abc9f => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:20:06.549678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1ae60f44-4b40-4a91-b491-d4cc46705d79 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f3704374ee0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:06.644419 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1ae60f44-4b40-4a91-b491-d4cc46705d79 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098443 Sep 08 16:20:06.645259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 300/573] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Sep 8 16:20:06 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:06.662519 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c7be60f5-1f02-44ce-99c2-44fbdd728ea5 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f3704697700>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:06.781149 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c7be60f5-1f02-44ce-99c2-44fbdd728ea5 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.125939 Sep 08 16:20:06.781738 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 274/574] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Sep 8 16:20:06 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:06.795547 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8c5fca2f-002e-4153-a195-44e27f1676d9 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f37046ae9d0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:06.889150 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8c5fca2f-002e-4153-a195-44e27f1676d9 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097463 Sep 08 16:20:06.891532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 301/575] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Sep 8 16:20:06 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:06.906176 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6f69bb7e-0ee5-48ed-858f-8b9530725c57 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f37045b4160>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:06.925618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:06.926833 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:06.943796 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:06.945570 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:06.947757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:06.949249 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:07.080900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6f69bb7e-0ee5-48ed-858f-8b9530725c57 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.179269 Sep 08 16:20:07.081642 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 275/576] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Sep 8 16:20:06 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:07.101883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d040ce7a-e600-4477-b7e7-9a0d0b961d29 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f37045b4670>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:07.262282 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d040ce7a-e600-4477-b7e7-9a0d0b961d29 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.167357 Sep 08 16:20:07.263262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 276/577] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Sep 8 16:20:07 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:07.285353 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a406a82b-3fce-4b62-94a0-dcbc322d1738 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f37046971f0>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:07.312820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:07.331173 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-be82c3de-a495-4d3e-a76c-e53083e33424 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.411275 Sep 08 16:20:07.332257 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 302/578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:06 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:07.443270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a406a82b-3fce-4b62-94a0-dcbc322d1738 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.165751 Sep 08 16:20:07.444496 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 277/579] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Sep 8 16:20:07 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:07.456326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b1d867bd-0dad-4c72-874e-c8b2818128bc tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f37046c0b80>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:07.544080 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b1d867bd-0dad-4c72-874e-c8b2818128bc tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091911 Sep 08 16:20:07.544659 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 303/580] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Sep 8 16:20:07 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:07.563440 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5200adfc-3c93-4d49-9f70-aff621cb6e84 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] Calling method '.version_select at 0x7f3704777790>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:07.668364 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5200adfc-3c93-4d49-9f70-aff621cb6e84 tempest-VolumesTestJSON-963497447 tempest-VolumesTestJSON-963497447-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.115006 Sep 08 16:20:07.668938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 278/581] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Sep 8 16:20:07 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:08.354545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:08.355716 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:08.370587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:08.371446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:08.372908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:08.373726 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:08.735446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:08.752376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c2db5fd2-fefa-41eb-aa76-49fa06936bb5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.404269 Sep 08 16:20:08.753264 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 304/582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:08 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:09.771091 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:09.772034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:09.780152 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:09.780628 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:09.781403 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:09.781846 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:10.034054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:10.045041 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-bf0763d6-c0ba-4e09-8004-07c830da78ac tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.278428 Sep 08 16:20:10.045757 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 279/583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:09 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:11.064518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:11.065211 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:11.072674 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:11.073126 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:11.073915 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:11.074353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:11.293121 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:11.302884 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-38ae6447-e785-4465-896e-4ebc5cc14cd0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.242250 Sep 08 16:20:11.303494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 305/584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:11 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:12.325408 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:12.326690 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:12.342439 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:12.343288 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:12.344777 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:12.346129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:12.649030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:12.666842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9e62b650-683a-470f-9d57-d2a39fc3695b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.348547 Sep 08 16:20:12.668747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 280/585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:12 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:13.700190 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:13.702660 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:13.723126 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:13.724339 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:13.726002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:13.727105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:14.144960 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:14.163670 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1adb2fa9-c80c-4a42-a776-e866f7c3afff tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.470537 Sep 08 16:20:14.165341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 306/586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:13 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:15.182967 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:15.183902 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:15.192586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:15.193447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:15.194326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:15.195179 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:15.493671 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:15.507326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ab11131a-a261-465b-a1aa-3e9b52c87001 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.328437 Sep 08 16:20:15.507968 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 281/587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:15 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:16.526935 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:16.528307 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:16.541017 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:16.541997 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:16.543321 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:16.544090 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:16.957659 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:16.968462 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-cf3809f0-52ec-4c30-ae69-0ad6466d9a75 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1678 microversion: 2.1 time: 0.447128 Sep 08 16:20:16.969156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 307/588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:16 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1678 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:18.001510 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:18.006169 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:18.030542 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:18.031760 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:18.033892 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:18.034883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:18.469756 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:18.487515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-121fde0f-3afe-43cd-9312-c600fc169eca tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1655 microversion: 2.1 time: 0.492462 Sep 08 16:20:18.488705 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 282/589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:17 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1655 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:18.516030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-efcb20f5-5649-4adb-a096-448586fce723 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:18.530311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-efcb20f5-5649-4adb-a096-448586fce723 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:18.531449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-efcb20f5-5649-4adb-a096-448586fce723 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:18.677710 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-efcb20f5-5649-4adb-a096-448586fce723 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Going to try to start instance {{(pid=93618) start /opt/stack/nova/nova/compute/api.py:2625}} Sep 08 16:20:18.847826 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-efcb20f5-5649-4adb-a096-448586fce723 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action" status: 202 len: 0 microversion: 2.1 time: 0.338430 Sep 08 16:20:18.848927 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 308/590] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:20:18 2021] POST /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:20:18.866339 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:18.870246 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:18.888249 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:18.889352 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:18.891051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:18.893156 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:19.328990 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:19.373285 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b4ba3009-4e3c-494a-99aa-2c24f1e8b9ce tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1664 microversion: 2.1 time: 0.512784 Sep 08 16:20:19.391914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 283/591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:18 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1664 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:20.417984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:20.423113 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:20.460069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:20.464055 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:20.468295 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:20.469176 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:20.763716 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:20.781507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2b5ea1ce-933e-4ce5-a7c3-d1d3519111a8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1664 microversion: 2.1 time: 0.375420 Sep 08 16:20:20.784007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 309/592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:20 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1664 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:21.804115 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:21.805461 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-88d25a6d-20fa-4f7e-8ad9-ac9f84e3a21e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:21.806074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:21.806245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-88d25a6d-20fa-4f7e-8ad9-ac9f84e3a21e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:21.818620 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:21.818926 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88d25a6d-20fa-4f7e-8ad9-ac9f84e3a21e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:21.818926 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88d25a6d-20fa-4f7e-8ad9-ac9f84e3a21e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:21.819171 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:21.819363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88d25a6d-20fa-4f7e-8ad9-ac9f84e3a21e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:21.819363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88d25a6d-20fa-4f7e-8ad9-ac9f84e3a21e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:21.819890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:21.820697 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:21.922135 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-88d25a6d-20fa-4f7e-8ad9-ac9f84e3a21e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments/87d249c5-9eba-447d-bb7a-b749ba95cae0" status: 200 len: 194 microversion: 2.20 time: 0.125442 Sep 08 16:20:21.933315 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 284/593] 10.222.0.25 () {60 vars in 1454 bytes} [Wed Sep 8 16:20:21 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments/87d249c5-9eba-447d-bb7a-b749ba95cae0 => generated 194 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:20:22.122703 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:22.133634 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-540f3048-d8e9-455c-8602-d2d1a4ebdf81 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1668 microversion: 2.1 time: 0.336263 Sep 08 16:20:22.134385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 310/594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:21 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1668 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:22.201913 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:22.202471 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:22.210669 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:22.211120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:22.211967 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:22.212404 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:22.393194 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lazy-loading 'services' on Instance uuid b2dd36a3-a4b2-4d0e-8140-e629d0c9954d {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:20:22.541562 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-22856733-d856-44c3-89aa-00dbae99e740 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments/87d249c5-9eba-447d-bb7a-b749ba95cae0" status: 202 len: 0 microversion: 2.20 time: 0.343536 Sep 08 16:20:22.542251 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 285/595] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Sep 8 16:20:22 2021] DELETE /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments/87d249c5-9eba-447d-bb7a-b749ba95cae0 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 16:20:22.554307 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d624f614-4afd-4a02-98b0-6124952f1173 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:22.555915 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d624f614-4afd-4a02-98b0-6124952f1173 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:22.568902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d624f614-4afd-4a02-98b0-6124952f1173 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:22.569435 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d624f614-4afd-4a02-98b0-6124952f1173 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:22.570459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d624f614-4afd-4a02-98b0-6124952f1173 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:22.570962 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d624f614-4afd-4a02-98b0-6124952f1173 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:22.646347 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d624f614-4afd-4a02-98b0-6124952f1173 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099159 Sep 08 16:20:22.647258 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 311/596] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Sep 8 16:20:22 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:20:23.661273 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f78af786-8b02-4613-9c0b-71112daf5ff8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:23.663273 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f78af786-8b02-4613-9c0b-71112daf5ff8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:23.674230 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f78af786-8b02-4613-9c0b-71112daf5ff8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:23.674830 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f78af786-8b02-4613-9c0b-71112daf5ff8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:23.675892 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f78af786-8b02-4613-9c0b-71112daf5ff8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:23.676578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f78af786-8b02-4613-9c0b-71112daf5ff8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:23.748492 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f78af786-8b02-4613-9c0b-71112daf5ff8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091940 Sep 08 16:20:23.749071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 286/597] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Sep 8 16:20:23 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:20:24.766987 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c001d14d-8d9c-41d4-a15f-ea07a35e4ad6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:24.769184 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c001d14d-8d9c-41d4-a15f-ea07a35e4ad6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:24.785670 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c001d14d-8d9c-41d4-a15f-ea07a35e4ad6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:24.786819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c001d14d-8d9c-41d4-a15f-ea07a35e4ad6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:24.789171 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c001d14d-8d9c-41d4-a15f-ea07a35e4ad6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:24.790202 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c001d14d-8d9c-41d4-a15f-ea07a35e4ad6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:24.977237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c001d14d-8d9c-41d4-a15f-ea07a35e4ad6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.217154 Sep 08 16:20:24.978817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 312/598] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Sep 8 16:20:24 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d/os-volume_attachments => generated 25 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:25.119253 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:25.119843 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:25.127745 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:25.128196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:25.129006 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:25.129586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:25.197816 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:20:25.351119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-305fbdb7-e5c3-4b7a-ae33-62e46b4a4337 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 204 len: 0 microversion: 2.20 time: 0.235300 Sep 08 16:20:25.351799 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 287/599] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Sep 8 16:20:25 2021] DELETE /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 16:20:25.365449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:25.366710 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:25.381496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:25.382250 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:25.383566 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:25.384286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:26.044103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:26.060048 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:26.062179 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:26.063392 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c2daa158-53d7-4381-97bb-b313f7e80abc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.705531 Sep 08 16:20:26.065662 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 313/600] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:25 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:27.090349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:27.091667 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:27.105613 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:27.106600 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:27.108706 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:27.108706 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:27.742504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:27.759000 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:27.762815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:27.765388 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-29b718dd-78a6-4d6f-9751-ed936092779f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1722 microversion: 2.20 time: 0.682856 Sep 08 16:20:27.767776 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 288/601] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:27 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1722 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:28.800588 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:28.802961 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:28.825459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:28.826322 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:28.828661 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:28.829402 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:29.079870 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:29.097996 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:29.101235 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:29.103180 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3b3e2e83-0d1a-4eee-859e-fa8c058314eb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1655 microversion: 2.20 time: 0.310771 Sep 08 16:20:29.115523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 314/602] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:28 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1655 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:29.568685 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-78319088-9207-45be-9163-7e162751e83f req-23d4bfbc-019c-42af-89e8-f7538e7945c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dd36a3-a4b2-4d0e-8140-e629d0c9954d", "name": "network-vif-deleted", "tag": "625c811b-4427-4c32-9c2e-61a56adb42db"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:29.570429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:20:29.570429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:20:29.589618 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-78319088-9207-45be-9163-7e162751e83f req-23d4bfbc-019c-42af-89e8-f7538e7945c7 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:29.590388 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-78319088-9207-45be-9163-7e162751e83f req-23d4bfbc-019c-42af-89e8-f7538e7945c7 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:29.635836 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-78319088-9207-45be-9163-7e162751e83f req-23d4bfbc-019c-42af-89e8-f7538e7945c7 service nova] Creating event network-vif-deleted:625c811b-4427-4c32-9c2e-61a56adb42db for instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d on hv-cinder-80789 Sep 08 16:20:29.647012 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-78319088-9207-45be-9163-7e162751e83f req-23d4bfbc-019c-42af-89e8-f7538e7945c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082572 Sep 08 16:20:29.647644 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 289/603] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:20:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:30.134325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:30.135193 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:30.151427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:30.152086 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:30.152957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:30.153507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:30.350709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:30.351529 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:30.352224 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lazy-loading 'fault' on Instance uuid b2dd36a3-a4b2-4d0e-8140-e629d0c9954d {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:20:30.463166 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:30.473066 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:30.475207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:30.476217 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-da604e0a-d407-48a8-9bb8-d5306b74f3ff tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 200 len: 1370 microversion: 2.20 time: 0.345883 Sep 08 16:20:30.489000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 315/604] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:30 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 1370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:31.497353 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:31.498145 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:31.507124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:31.507612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:31.508422 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:31.512887 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:31.565397 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] HTTP exception thrown: Instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d could not be found. Sep 08 16:20:31.566002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Returning 404 to user: Instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:20:31.566842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5c4ad11d-bd2d-4ad4-9485-3f7d25f90f1d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 404 len: 111 microversion: 2.20 time: 0.074123 Sep 08 16:20:31.567403 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 290/605] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:31 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 16:20:31.584413 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d8b094e1-0d6b-43ee-9c05-3b6c03180500 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '.version_select at 0x7f37046db4c0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:31.619914 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d8b094e1-0d6b-43ee-9c05-3b6c03180500 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-535086486" status: 204 len: 0 microversion: 2.20 time: 0.044613 Sep 08 16:20:31.621377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 316/606] 10.222.0.25 () {60 vars in 1259 bytes} [Wed Sep 8 16:20:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-535086486 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:20:31.822551 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:20:31.823361 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:20:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:20:33.157550 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5150d067-e929-4401-b9ef-d744bc3f5f10 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'create', calling method: .version_select at 0x7f3704747af0>, body: {"keypair": {"name": "tempest-keypair-1184396738"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:33.183438 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-5150d067-e929-4401-b9ef-d744bc3f5f10 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:20:33.188404 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-5150d067-e929-4401-b9ef-d744bc3f5f10 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for user e8b8e261b03145bbbb513a7044de5211 and project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:20:33.591881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-5150d067-e929-4401-b9ef-d744bc3f5f10 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:20:33.597416 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-5150d067-e929-4401-b9ef-d744bc3f5f10 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for user e8b8e261b03145bbbb513a7044de5211 and project 8151b8f5193c4e4eb58002780ae62270. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:20:33.613259 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5150d067-e929-4401-b9ef-d744bc3f5f10 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.460142 Sep 08 16:20:33.613857 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 291/607] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Sep 8 16:20:33 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 462 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Sep 08 16:20:35.804606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1666667054", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75dd61b0-379a-4abd-83d0-357fccbfe480"}], "security_groups": [{"name": "tempest-securitygroup--380027074"}], "key_name": "tempest-keypair-1184396738", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:35.982969 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] validate_networks() for [('75dd61b0-379a-4abd-83d0-357fccbfe480', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:20:36.853703 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:20:36.854781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:20:36.855334 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:20:36.855988 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:20:36.856835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:20:36.873439 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:36.874544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:36.876509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:36.878146 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:36.920307 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for project 8151b8f5193c4e4eb58002780ae62270. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:20:36.930105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Getting quotas for user e8b8e261b03145bbbb513a7044de5211 and project 8151b8f5193c4e4eb58002780ae62270. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:20:36.954171 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:20:36.970744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:20:37.046404 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c943b97a-f04e-43d6-89d4-b078c0a53ed3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.249882 Sep 08 16:20:37.047708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 317/608] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Sep 8 16:20:35 2021] POST /compute/v2.1/servers => generated 401 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 16:20:37.060695 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-73c073d0-489d-44a4-8e89-2dde40448580 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:37.061972 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-73c073d0-489d-44a4-8e89-2dde40448580 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:37.141877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-73c073d0-489d-44a4-8e89-2dde40448580 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:37.152111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-73c073d0-489d-44a4-8e89-2dde40448580 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:37.153934 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-73c073d0-489d-44a4-8e89-2dde40448580 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:37.155244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-73c073d0-489d-44a4-8e89-2dde40448580 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1282 microversion: 2.20 time: 0.099453 Sep 08 16:20:37.156141 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 292/609] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:37 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:38.185677 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:38.186694 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:38.197134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:38.197846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:38.199030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:38.199982 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:38.392177 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:38.403849 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:38.405538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:38.407003 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fcc7b6cd-1ea5-4125-a531-91aecd8fe448 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1334 microversion: 2.20 time: 0.225679 Sep 08 16:20:38.407832 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 318/610] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:38 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1334 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:39.436954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:39.439044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:39.455305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:39.456593 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:39.458301 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:39.459459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:39.657721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:39.675712 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:39.679261 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:39.681455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4f131e7b-16a3-424f-91e6-18f6b1ed1bc5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1340 microversion: 2.20 time: 0.252213 Sep 08 16:20:39.682459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 293/611] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:39 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1340 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:20:40.705891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:40.708415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:40.723768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:40.724735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:40.725741 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:40.726378 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:41.132904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:41.148134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:41.151447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:41.153992 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d2b70c26-62d7-4393-be23-06783d4f2cbe tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.455978 Sep 08 16:20:41.155081 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 319/612] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:40 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:42.176555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:42.177590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:42.188792 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:42.198327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:42.199523 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:42.200152 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:42.404013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-f42b15cb-cf7b-46cd-b1ad-2f588773af70 req-5ad4c62e-c7ec-49f1-89e3-39881e35b058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5fbdd8-f58c-4d16-be45-d9003f0e770c", "tag": "0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:42.413817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:20:42.413817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:20:42.434395 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-f42b15cb-cf7b-46cd-b1ad-2f588773af70 req-5ad4c62e-c7ec-49f1-89e3-39881e35b058 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:42.435233 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-f42b15cb-cf7b-46cd-b1ad-2f588773af70 req-5ad4c62e-c7ec-49f1-89e3-39881e35b058 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:42.474254 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-f42b15cb-cf7b-46cd-b1ad-2f588773af70 req-5ad4c62e-c7ec-49f1-89e3-39881e35b058 service nova] Creating event network-changed:0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54 for instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c on hv-cinder-80789 Sep 08 16:20:42.483349 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-f42b15cb-cf7b-46cd-b1ad-2f588773af70 req-5ad4c62e-c7ec-49f1-89e3-39881e35b058 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093864 Sep 08 16:20:42.484862 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 320/613] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:20:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:42.764506 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:42.780955 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:42.785184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:42.787250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-dc44f8f0-2b42-4d66-a0d3-ef27934134b2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.617363 Sep 08 16:20:42.788313 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 294/614] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:42 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:43.823215 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:43.831286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:43.844651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:43.845110 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:43.846970 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:43.847415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:44.392857 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:44.404755 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:44.406946 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:44.408599 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-19d0e6df-6966-4b7f-bf9a-4e858c118532 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.593641 Sep 08 16:20:44.409646 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 321/615] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:43 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:45.440520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:45.442109 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:45.456812 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:45.457658 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:45.459165 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:45.460139 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:45.805590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:45.818744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:45.820643 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:45.822165 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-95ae9322-1efa-4c9f-a95e-93a3742be936 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.389291 Sep 08 16:20:45.823151 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 295/616] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:45 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:46.844649 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:46.845369 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:46.856913 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:46.857716 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:46.859121 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:46.859929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:47.234785 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:47.256180 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:47.257856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:47.259071 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4ec9791b-236f-47f3-a243-bffae0ba3617 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.418306 Sep 08 16:20:47.259738 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 322/617] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:46 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:48.293848 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:48.294717 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:48.308237 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:48.308880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:48.310198 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:48.311053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:48.746260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:48.762779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:48.765417 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:48.766846 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0609b02e-d339-4efa-956b-dff7acf1c42c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.479717 Sep 08 16:20:48.768719 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 296/618] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:48 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:49.271751 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-56067fe0-3dff-45fa-85e8-a4559621aaea req-3feb050c-011a-48fa-9cd6-053c1081627a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5fbdd8-f58c-4d16-be45-d9003f0e770c", "name": "network-vif-plugged", "status": "completed", "tag": "0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:49.275031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:20:49.275031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:20:49.281430 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 16:20:49.289647 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-56067fe0-3dff-45fa-85e8-a4559621aaea req-3feb050c-011a-48fa-9cd6-053c1081627a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:49.290353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-56067fe0-3dff-45fa-85e8-a4559621aaea req-3feb050c-011a-48fa-9cd6-053c1081627a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:49.327984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-56067fe0-3dff-45fa-85e8-a4559621aaea req-3feb050c-011a-48fa-9cd6-053c1081627a service nova] Creating event network-vif-plugged:0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54 for instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c on hv-cinder-80789 Sep 08 16:20:49.337833 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-56067fe0-3dff-45fa-85e8-a4559621aaea req-3feb050c-011a-48fa-9cd6-053c1081627a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074062 Sep 08 16:20:49.339076 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 323/619] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:20:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:20:49.795415 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:49.796647 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:49.811197 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:49.812473 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:49.814296 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:49.815721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:50.203163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:50.215111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:50.216857 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:50.217982 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b0d1cfe1-ceb9-40dc-880a-23782fbf668a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.431084 Sep 08 16:20:50.223877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 297/620] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:49 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:51.256563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:51.257377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:51.268777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59540. Sep 08 16:20:51.277144 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:51.277701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:51.279063 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:51.280129 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:51.677068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:51.693881 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:51.695757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:51.697003 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f66e1515-7e51-4afe-a53f-1ce625f0dd05 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1407 microversion: 2.20 time: 0.463008 Sep 08 16:20:51.697669 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 324/621] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:51 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:20:52.723771 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:52.726657 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:52.741965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:52.743071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:52.744462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:52.745218 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:53.130429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:53.141032 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:53.144445 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:53.145849 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a2c51d33-5b3a-4227-9836-76cb0c14c8a0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1600 microversion: 2.20 time: 0.429468 Sep 08 16:20:53.159508 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 298/622] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:20:52 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1600 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:20:53.169046 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7d544508-e82a-486a-92df-934756c190a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:53.170945 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7d544508-e82a-486a-92df-934756c190a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:53.185307 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d544508-e82a-486a-92df-934756c190a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:53.186216 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d544508-e82a-486a-92df-934756c190a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:53.187754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d544508-e82a-486a-92df-934756c190a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:53.188890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d544508-e82a-486a-92df-934756c190a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:53.412128 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7d544508-e82a-486a-92df-934756c190a6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.250861 Sep 08 16:20:53.413093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 325/623] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Sep 8 16:20:53 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:20:55.023211 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1856630190", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "2387d553-0a72-48c0-a9df-0fcfa0f93147"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:55.125423 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] validate_networks() for [('2387d553-0a72-48c0-a9df-0fcfa0f93147', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:20:55.762588 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a7be77d8-735d-4182-b99b-ce498b47f2cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:55.764758 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a7be77d8-735d-4182-b99b-ce498b47f2cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:55.775709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7be77d8-735d-4182-b99b-ce498b47f2cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:55.776321 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7be77d8-735d-4182-b99b-ce498b47f2cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:55.777503 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7be77d8-735d-4182-b99b-ce498b47f2cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:55.778116 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a7be77d8-735d-4182-b99b-ce498b47f2cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:55.863814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a7be77d8-735d-4182-b99b-ce498b47f2cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112645 Sep 08 16:20:55.865322 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 326/624] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:20:55 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 16:20:56.032088 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5d18fc09-17fd-4db6-b5e1-7aebac07ff77 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:56.033830 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5d18fc09-17fd-4db6-b5e1-7aebac07ff77 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:56.052064 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d18fc09-17fd-4db6-b5e1-7aebac07ff77 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.052963 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d18fc09-17fd-4db6-b5e1-7aebac07ff77 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.054080 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d18fc09-17fd-4db6-b5e1-7aebac07ff77 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.054684 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d18fc09-17fd-4db6-b5e1-7aebac07ff77 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.202279 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5d18fc09-17fd-4db6-b5e1-7aebac07ff77 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 14 microversion: 2.20 time: 0.174037 Sep 08 16:20:56.208807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 327/625] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:20:56 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:56.209507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-15b43a74-284c-44a3-b60d-e9c8e6b448a4 req-c932bb93-34d4-4509-a2fd-0f13032fd87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5fbdd8-f58c-4d16-be45-d9003f0e770c", "tag": "0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:56.211086 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:20:56.211086 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:20:56.221984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-15b43a74-284c-44a3-b60d-e9c8e6b448a4 req-c932bb93-34d4-4509-a2fd-0f13032fd87c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.222442 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-15b43a74-284c-44a3-b60d-e9c8e6b448a4 req-c932bb93-34d4-4509-a2fd-0f13032fd87c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.241472 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-15b43a74-284c-44a3-b60d-e9c8e6b448a4 req-c932bb93-34d4-4509-a2fd-0f13032fd87c service nova] Creating event network-changed:0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54 for instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c on hv-cinder-80789 Sep 08 16:20:56.246827 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-15b43a74-284c-44a3-b60d-e9c8e6b448a4 req-c932bb93-34d4-4509-a2fd-0f13032fd87c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042421 Sep 08 16:20:56.247696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 328/626] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:20:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:20:56.254084 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:56.254921 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:56.264510 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.265205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.266563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.270567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.426209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:20:56.691164 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:20:56.692305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:20:56.692943 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:20:56.693593 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:20:56.694163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:20:56.715359 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.719381 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.721538 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.722372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.748770 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-467fac2c-b7d0-44e7-a53f-81fa58862aa9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 204 len: 0 microversion: 2.1 time: 0.498508 Sep 08 16:20:56.749874 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 329/627] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:20:56 2021] DELETE /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:20:56.762038 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:56.764186 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:56.778886 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.779921 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.781059 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:56.781673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:56.806716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Getting quotas for project 633ffbd0760e4ad69bef0e867ad6c4b9. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:20:56.813854 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Getting quotas for user dc3811fbb13d4488bd68feafdb8da149 and project 633ffbd0760e4ad69bef0e867ad6c4b9. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:20:56.844348 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:20:56.852650 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:20:56.992756 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2c82119a-705f-4ee4-a2b8-28d39839aa54 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977337 Sep 08 16:20:56.993461 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 299/628] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:20:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:20:57.023007 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9effcd32-e13b-4119-be12-b47470fead39 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:57.024216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9effcd32-e13b-4119-be12-b47470fead39 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:57.401435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9effcd32-e13b-4119-be12-b47470fead39 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:57.414324 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9effcd32-e13b-4119-be12-b47470fead39 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1214 microversion: 2.1 time: 0.395700 Sep 08 16:20:57.415210 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 300/629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:57 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1214 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:57.424298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d001dfaf-262e-4840-926d-024add10932f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:57.433640 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d001dfaf-262e-4840-926d-024add10932f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:57.448007 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d001dfaf-262e-4840-926d-024add10932f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:57.448769 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d001dfaf-262e-4840-926d-024add10932f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:57.450245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d001dfaf-262e-4840-926d-024add10932f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:57.450826 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d001dfaf-262e-4840-926d-024add10932f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:57.538263 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:57.550265 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-eb0350e9-1937-4bb8-938f-828ecd2f18c3 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1674 microversion: 2.1 time: 0.791448 Sep 08 16:20:57.550531 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 330/630] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:56 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1674 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:57.693317 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d001dfaf-262e-4840-926d-024add10932f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 14 microversion: 2.20 time: 0.276314 Sep 08 16:20:57.696606 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 301/631] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:20:57 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 14 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:20:58.442220 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:58.443504 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:58.452770 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:58.453430 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:58.454381 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:58.455234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:58.602584 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:58.622354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:58.628319 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:58.633266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d1b2d1ed-1bfd-4716-b907-f705e963577a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1266 microversion: 2.1 time: 0.194446 Sep 08 16:20:58.634163 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 331/632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:58 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:58.647512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:58.648301 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:58.649717 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:58.650451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:59.039262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:59.062276 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-efba9101-c2ab-4c26-b6cd-d948602b4a13 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1674 microversion: 2.1 time: 0.449042 Sep 08 16:20:59.064163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 302/633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:58 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1674 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:59.130083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-07130730-b3c5-4516-a0d1-a939bc710ad1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:20:59.131546 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-07130730-b3c5-4516-a0d1-a939bc710ad1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:59.141464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07130730-b3c5-4516-a0d1-a939bc710ad1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:59.142438 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07130730-b3c5-4516-a0d1-a939bc710ad1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:59.143961 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07130730-b3c5-4516-a0d1-a939bc710ad1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:59.144784 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-07130730-b3c5-4516-a0d1-a939bc710ad1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:59.322222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-07130730-b3c5-4516-a0d1-a939bc710ad1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 14 microversion: 2.20 time: 0.620606 Sep 08 16:20:59.323299 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 332/634] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:20:58 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 14 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:20:59.652259 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:20:59.653400 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:20:59.664490 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:59.665229 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:59.666461 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:20:59.667231 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:20:59.848791 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:20:59.867642 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a381aee4-bb1e-4bb7-827d-37868fbe1102 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1272 microversion: 2.1 time: 0.218890 Sep 08 16:20:59.869838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 303/635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:20:59 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:00.337426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-30f780fb-9a42-4b7d-b1d2-630142c1af0d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:00.340535 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-30f780fb-9a42-4b7d-b1d2-630142c1af0d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:00.356116 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-30f780fb-9a42-4b7d-b1d2-630142c1af0d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:00.357547 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-30f780fb-9a42-4b7d-b1d2-630142c1af0d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:00.359399 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-30f780fb-9a42-4b7d-b1d2-630142c1af0d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:00.360902 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-30f780fb-9a42-4b7d-b1d2-630142c1af0d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:00.414622 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:00.418529 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:00.436473 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:00.438072 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:00.442282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:00.443363 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:00.587906 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-30f780fb-9a42-4b7d-b1d2-630142c1af0d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 14 microversion: 2.20 time: 0.247287 Sep 08 16:21:00.592611 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 304/636] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:00 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 14 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:00.880584 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:00.891618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dd9e4bf5-bc93-47cb-b77b-dff1a43f07bc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1674 microversion: 2.1 time: 0.807525 Sep 08 16:21:00.893731 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 333/637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:00 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1674 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:00.929696 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:00.931590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:00.952644 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:00.953461 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:00.955407 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:00.956234 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:01.281384 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:01.312654 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6eddb6c5-2732-4f05-9a11-a8e235ce942b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.418463 Sep 08 16:21:01.314355 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 305/638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:00 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:01.602737 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-66ad507f-c315-4ec1-a281-db13b4f60cdc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:01.604114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-66ad507f-c315-4ec1-a281-db13b4f60cdc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:01.616408 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66ad507f-c315-4ec1-a281-db13b4f60cdc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:01.617308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66ad507f-c315-4ec1-a281-db13b4f60cdc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:01.618707 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66ad507f-c315-4ec1-a281-db13b4f60cdc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:01.619545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-66ad507f-c315-4ec1-a281-db13b4f60cdc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:01.778185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-66ad507f-c315-4ec1-a281-db13b4f60cdc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 14 microversion: 2.20 time: 0.179913 Sep 08 16:21:01.784261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 334/639] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:01 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:01.934785 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:01.945783 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:01.990569 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:01.998482 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:02.002781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:02.004184 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:02.309744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:02.332753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-df0a002b-1cda-46af-a58e-7e108d61631d tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 200 len: 1322 microversion: 2.1 time: 0.408942 Sep 08 16:21:02.334241 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 335/640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:01 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:02.354127 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:02.355734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:02.371375 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-0a1da220-01f9-4473-a54a-ca05ea588657 req-a2f17592-32c9-41e3-a046-733b796cdd23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db24e43-208d-4d9e-a75c-98f3168ab156", "name": "network-vif-deleted", "tag": "ada104b9-d491-45ae-a144-07da180661e5"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:02.377222 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:02.377222 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:02.380587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:02.382984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:02.384451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:02.385214 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:02.411374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-0a1da220-01f9-4473-a54a-ca05ea588657 req-a2f17592-32c9-41e3-a046-733b796cdd23 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:02.412148 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-0a1da220-01f9-4473-a54a-ca05ea588657 req-a2f17592-32c9-41e3-a046-733b796cdd23 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:02.485389 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-0a1da220-01f9-4473-a54a-ca05ea588657 req-a2f17592-32c9-41e3-a046-733b796cdd23 service nova] Creating event network-vif-deleted:ada104b9-d491-45ae-a144-07da180661e5 for instance 3db24e43-208d-4d9e-a75c-98f3168ab156 on hv-cinder-80789 Sep 08 16:21:02.502376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-0a1da220-01f9-4473-a54a-ca05ea588657 req-a2f17592-32c9-41e3-a046-733b796cdd23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.606731 Sep 08 16:21:02.504616 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 306/641] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:02.803346 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-84c4572d-1fe6-427d-95a8-bb74cad15abd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:02.806655 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-84c4572d-1fe6-427d-95a8-bb74cad15abd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:02.826867 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-84c4572d-1fe6-427d-95a8-bb74cad15abd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:02.828217 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-84c4572d-1fe6-427d-95a8-bb74cad15abd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:02.832753 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-84c4572d-1fe6-427d-95a8-bb74cad15abd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:02.834120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-84c4572d-1fe6-427d-95a8-bb74cad15abd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:03.036625 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-84c4572d-1fe6-427d-95a8-bb74cad15abd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 14 microversion: 2.20 time: 0.247418 Sep 08 16:21:03.037657 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 307/642] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:02 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:03.067885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:03.121371 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9079e87f-0c51-41ba-a239-31e1dd642a45 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.781466 Sep 08 16:21:03.122527 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 336/643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:02 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:03.370192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:03.372037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:03.396915 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:03.398812 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:03.401107 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:03.402329 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:03.603527 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] HTTP exception thrown: Instance 3db24e43-208d-4d9e-a75c-98f3168ab156 could not be found. Sep 08 16:21:03.607252 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Returning 404 to user: Instance 3db24e43-208d-4d9e-a75c-98f3168ab156 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:21:03.611261 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ee675e00-43b4-45e7-8adc-ddbff36e16d7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 404 len: 111 microversion: 2.1 time: 0.249962 Sep 08 16:21:03.630093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7849a526-2f69-4bbc-9bc7-9d9bd4a2befd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '.version_select at 0x7f3704308af0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:03.631069 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 308/644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:03 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 111 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:21:03.687020 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7849a526-2f69-4bbc-9bc7-9d9bd4a2befd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475915403" status: 202 len: 0 microversion: 2.1 time: 0.064141 Sep 08 16:21:03.689730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 337/645] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Sep 8 16:21:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475915403 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:04.055795 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7b593858-3f13-48a3-a61b-944f0a4cc282 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:04.057966 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7b593858-3f13-48a3-a61b-944f0a4cc282 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:04.093040 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b593858-3f13-48a3-a61b-944f0a4cc282 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:04.093498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b593858-3f13-48a3-a61b-944f0a4cc282 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:04.094315 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b593858-3f13-48a3-a61b-944f0a4cc282 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:04.100703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b593858-3f13-48a3-a61b-944f0a4cc282 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:04.144894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:04.146062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:04.174463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:04.175204 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:04.176658 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:04.177497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:04.287184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7b593858-3f13-48a3-a61b-944f0a4cc282 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 6451 microversion: 2.20 time: 0.241575 Sep 08 16:21:04.289268 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 309/646] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:04 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 6451 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:04.535218 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-6fbfcc04-6c7b-4502-a3e4-588474b92b99 req-5a1f98bb-35c3-41bd-a763-9ecd3b24359e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4e7159-bfde-4aca-bb0b-b059f6980e77", "tag": "e6f8642b-2e45-416d-a08c-643ab2581966"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:04.539209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:04.539209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:04.559046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-6fbfcc04-6c7b-4502-a3e4-588474b92b99 req-5a1f98bb-35c3-41bd-a763-9ecd3b24359e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:04.560222 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-6fbfcc04-6c7b-4502-a3e4-588474b92b99 req-5a1f98bb-35c3-41bd-a763-9ecd3b24359e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:04.602298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-6fbfcc04-6c7b-4502-a3e4-588474b92b99 req-5a1f98bb-35c3-41bd-a763-9ecd3b24359e service nova] Creating event network-changed:e6f8642b-2e45-416d-a08c-643ab2581966 for instance 6e4e7159-bfde-4aca-bb0b-b059f6980e77 on hv-cinder-80789 Sep 08 16:21:04.613145 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-6fbfcc04-6c7b-4502-a3e4-588474b92b99 req-5a1f98bb-35c3-41bd-a763-9ecd3b24359e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087127 Sep 08 16:21:04.614319 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 310/647] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:21:05.042754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:05.056513 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-89526005-ad9e-4926-8747-9b09fc538c51 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.921075 Sep 08 16:21:05.057696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 338/648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:04 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:05.302305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-970d63b0-18d8-48d2-a936-0b0a3563ac3c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:05.303956 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-970d63b0-18d8-48d2-a936-0b0a3563ac3c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:05.312422 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-970d63b0-18d8-48d2-a936-0b0a3563ac3c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:05.313245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-970d63b0-18d8-48d2-a936-0b0a3563ac3c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:05.314351 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-970d63b0-18d8-48d2-a936-0b0a3563ac3c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:05.315181 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-970d63b0-18d8-48d2-a936-0b0a3563ac3c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:05.451095 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-970d63b0-18d8-48d2-a936-0b0a3563ac3c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 15025 microversion: 2.20 time: 0.153185 Sep 08 16:21:05.453541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 311/649] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:05 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 15025 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:06.080823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:06.083050 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:06.101798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:06.102970 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:06.109778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:06.111677 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:06.467442 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-63d70c59-eeb0-4fac-b78d-f93772937c8f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:06.469461 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-63d70c59-eeb0-4fac-b78d-f93772937c8f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:06.479884 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63d70c59-eeb0-4fac-b78d-f93772937c8f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:06.480324 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63d70c59-eeb0-4fac-b78d-f93772937c8f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:06.481343 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63d70c59-eeb0-4fac-b78d-f93772937c8f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:06.481775 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63d70c59-eeb0-4fac-b78d-f93772937c8f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:06.642714 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-63d70c59-eeb0-4fac-b78d-f93772937c8f tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 18498 microversion: 2.20 time: 0.178904 Sep 08 16:21:06.650917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 312/650] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:06 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 18498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:21:06.758402 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:06.775197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-659cebfd-8c37-46be-ab08-a1af8909ae74 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.703698 Sep 08 16:21:06.776031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 339/651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:06 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:07.042127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0a4470c0-46b3-4d53-b48a-d3446445343a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'create', calling method: .version_select at 0x7f3704774940>, body: {"keypair": {"name": "tempest-keypair-2064233452"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:07.080141 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-0a4470c0-46b3-4d53-b48a-d3446445343a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:21:07.087045 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-0a4470c0-46b3-4d53-b48a-d3446445343a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for user 3fe3a59305f044fa87cd6a1cb91d8e0c and project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:21:07.426661 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-0a4470c0-46b3-4d53-b48a-d3446445343a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:21:07.432523 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-0a4470c0-46b3-4d53-b48a-d3446445343a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for user 3fe3a59305f044fa87cd6a1cb91d8e0c and project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:21:07.450552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0a4470c0-46b3-4d53-b48a-d3446445343a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.413713 Sep 08 16:21:07.452471 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 313/652] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Sep 8 16:21:07 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:07.662092 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fa059ff9-4250-45eb-9fb5-4297eb50a9f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:07.663381 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fa059ff9-4250-45eb-9fb5-4297eb50a9f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:07.675069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fa059ff9-4250-45eb-9fb5-4297eb50a9f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:07.675838 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fa059ff9-4250-45eb-9fb5-4297eb50a9f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:07.677081 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fa059ff9-4250-45eb-9fb5-4297eb50a9f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:07.678130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fa059ff9-4250-45eb-9fb5-4297eb50a9f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:07.793335 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:07.794093 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:07.817559 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:07.818503 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:07.819508 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:07.820226 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:07.874724 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fa059ff9-4250-45eb-9fb5-4297eb50a9f7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 20214 microversion: 2.20 time: 0.220265 Sep 08 16:21:07.882401 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 340/653] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:07 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 20214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:08.234245 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:08.260476 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-78065aab-5bf1-4d86-9253-c424f05da647 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.470946 Sep 08 16:21:08.272288 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 314/654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:07 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:08.889594 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a47a4f64-e155-40ed-8d92-4af82b2b3481 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:08.892528 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a47a4f64-e155-40ed-8d92-4af82b2b3481 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:08.904798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a47a4f64-e155-40ed-8d92-4af82b2b3481 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:08.905723 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a47a4f64-e155-40ed-8d92-4af82b2b3481 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:08.907147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a47a4f64-e155-40ed-8d92-4af82b2b3481 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:08.909170 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a47a4f64-e155-40ed-8d92-4af82b2b3481 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:09.074809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a47a4f64-e155-40ed-8d92-4af82b2b3481 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 22893 microversion: 2.20 time: 0.189838 Sep 08 16:21:09.080506 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 341/655] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:08 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 22893 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:09.288396 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:09.289282 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:09.296937 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:09.297370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:09.298953 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:09.299880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:09.776680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:09.807051 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cd9861cd-4b25-478d-8997-8b5e8cf42ed7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.521609 Sep 08 16:21:09.809774 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 315/656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:09 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:10.097779 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8df93acd-5203-4e57-9cb5-4f15ca812b1c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:10.103322 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8df93acd-5203-4e57-9cb5-4f15ca812b1c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:10.128265 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8df93acd-5203-4e57-9cb5-4f15ca812b1c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:10.132109 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8df93acd-5203-4e57-9cb5-4f15ca812b1c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:10.133293 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8df93acd-5203-4e57-9cb5-4f15ca812b1c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:10.133905 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8df93acd-5203-4e57-9cb5-4f15ca812b1c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:10.301191 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8df93acd-5203-4e57-9cb5-4f15ca812b1c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 24325 microversion: 2.20 time: 0.213295 Sep 08 16:21:10.307606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 342/657] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:10 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 24325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:10.536922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1643665064", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "582096af-2f90-402d-b754-a13d85dcf0f9"}], "security_groups": [{"name": "tempest-securitygroup--757770502"}], "key_name": "tempest-keypair-2064233452", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:10.773287 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] validate_networks() for [('582096af-2f90-402d-b754-a13d85dcf0f9', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:21:10.828131 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:10.829163 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:10.839771 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:10.840644 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:10.841661 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:10.842260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:11.271100 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:11.288267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-56dac056-9e30-4f4a-910f-23b7fe6eca65 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.464709 Sep 08 16:21:11.292630 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 343/658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:10 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:11.317523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-df0c550e-4f7b-4a84-be4b-d3f9781b8fba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:11.318918 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-df0c550e-4f7b-4a84-be4b-d3f9781b8fba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:11.332265 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0c550e-4f7b-4a84-be4b-d3f9781b8fba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:11.332742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0c550e-4f7b-4a84-be4b-d3f9781b8fba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:11.333545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0c550e-4f7b-4a84-be4b-d3f9781b8fba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:11.334001 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-df0c550e-4f7b-4a84-be4b-d3f9781b8fba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:11.573850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-df0c550e-4f7b-4a84-be4b-d3f9781b8fba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 26255 microversion: 2.20 time: 0.260078 Sep 08 16:21:11.575381 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 344/659] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:11 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 26255 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:21:11.986938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:21:11.988829 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:21:11.989802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:21:11.990566 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:21:11.991522 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:21:11.998506 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-00cea7fc-07bc-4511-b293-53f9bedcda16 req-03c28d31-6849-487a-a43e-13c88762503a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4e7159-bfde-4aca-bb0b-b059f6980e77", "name": "network-vif-plugged", "status": "completed", "tag": "e6f8642b-2e45-416d-a08c-643ab2581966"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:12.002891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:12.002891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:21:12.007817 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:12.008782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:12.010335 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:12.011105 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:12.022785 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-00cea7fc-07bc-4511-b293-53f9bedcda16 req-03c28d31-6849-487a-a43e-13c88762503a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:12.024778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-00cea7fc-07bc-4511-b293-53f9bedcda16 req-03c28d31-6849-487a-a43e-13c88762503a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:12.045026 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:21:12.051610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Getting quotas for user 3fe3a59305f044fa87cd6a1cb91d8e0c and project 212c97f3a57a4db5985bce4f60183ab4. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:21:12.057394 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-00cea7fc-07bc-4511-b293-53f9bedcda16 req-03c28d31-6849-487a-a43e-13c88762503a service nova] Creating event network-vif-plugged:e6f8642b-2e45-416d-a08c-643ab2581966 for instance 6e4e7159-bfde-4aca-bb0b-b059f6980e77 on hv-cinder-80789 Sep 08 16:21:12.065654 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:21:12.066782 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-00cea7fc-07bc-4511-b293-53f9bedcda16 req-03c28d31-6849-487a-a43e-13c88762503a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080410 Sep 08 16:21:12.068090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:21:12.068576 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 345/660] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:21:12.135249 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-41fd9714-390f-4b00-9034-c0285e17a6e7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.608089 Sep 08 16:21:12.139267 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 316/661] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:21:10 2021] POST /compute/v2.1/servers => generated 401 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:21:12.156799 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-feaaab25-a58e-493b-858f-66877cca6266 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:12.166967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-feaaab25-a58e-493b-858f-66877cca6266 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:12.309351 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:12.310502 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:12.344144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:12.346986 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:12.348774 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:12.353002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:12.601036 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-feaaab25-a58e-493b-858f-66877cca6266 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:12.631092 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-feaaab25-a58e-493b-858f-66877cca6266 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1238 microversion: 2.1 time: 0.481586 Sep 08 16:21:12.639567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 346/662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:12 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1238 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:12.648159 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-055ba487-9383-4cec-8c3b-4c0836f12339 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:12.660138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-055ba487-9383-4cec-8c3b-4c0836f12339 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:12.688017 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-055ba487-9383-4cec-8c3b-4c0836f12339 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:12.689760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-055ba487-9383-4cec-8c3b-4c0836f12339 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:12.691241 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-055ba487-9383-4cec-8c3b-4c0836f12339 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:12.696574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-055ba487-9383-4cec-8c3b-4c0836f12339 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:12.855095 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:12.884162 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-89737226-642f-40e9-ad2e-96d1a74dd18d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.581437 Sep 08 16:21:12.899997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 317/663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:12 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:13.002516 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-055ba487-9383-4cec-8c3b-4c0836f12339 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 27664 microversion: 2.20 time: 0.360294 Sep 08 16:21:13.007043 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 347/664] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:12 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 27664 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:13.668244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:13.669301 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:13.681693 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:13.682429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:13.683810 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:13.684545 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:13.904398 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:13.916877 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:13.925428 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:13.935998 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6740e4fd-3631-4160-848e-ca66ef1d89d9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1290 microversion: 2.1 time: 0.274364 Sep 08 16:21:13.952837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 318/665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:13 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1290 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:13.973244 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:13.980466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:13.989395 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:13.990819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:14.031289 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e1f45c9c-9fd6-4586-be5a-aea6b0177a99 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:14.035456 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e1f45c9c-9fd6-4586-be5a-aea6b0177a99 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:14.084274 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e1f45c9c-9fd6-4586-be5a-aea6b0177a99 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:14.085302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e1f45c9c-9fd6-4586-be5a-aea6b0177a99 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:14.089944 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e1f45c9c-9fd6-4586-be5a-aea6b0177a99 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:14.091025 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e1f45c9c-9fd6-4586-be5a-aea6b0177a99 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:14.372204 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e1f45c9c-9fd6-4586-be5a-aea6b0177a99 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 28061 microversion: 2.20 time: 0.357397 Sep 08 16:21:14.373287 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 319/666] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:14 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 28061 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:14.641934 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:14.654065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dd705c3b-9ad8-41a5-8bb8-0a74abbcc988 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1314 microversion: 2.1 time: 0.745314 Sep 08 16:21:14.655147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 348/667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:13 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:14.965880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:14.967002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:14.976847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:14.978445 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:14.979447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:14.980035 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:15.153773 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:15.166065 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-59a857b2-be1b-4872-9a44-60dd0566cabd tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1296 microversion: 2.1 time: 0.204493 Sep 08 16:21:15.179711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 320/668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:14 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1296 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:15.391194 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-966e6749-df76-4a92-aa84-c1c26f18e3e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:15.393035 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-966e6749-df76-4a92-aa84-c1c26f18e3e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:15.430350 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966e6749-df76-4a92-aa84-c1c26f18e3e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:15.432880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966e6749-df76-4a92-aa84-c1c26f18e3e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:15.434705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966e6749-df76-4a92-aa84-c1c26f18e3e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:15.435804 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966e6749-df76-4a92-aa84-c1c26f18e3e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:15.674074 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:15.674940 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:15.691063 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:15.691586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:15.692437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:15.692828 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:15.704901 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-966e6749-df76-4a92-aa84-c1c26f18e3e4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 28146 microversion: 2.20 time: 0.320531 Sep 08 16:21:15.706041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 349/669] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:15 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 28146 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:21:16.187894 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:16.188550 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:16.200527 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:16.203537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.207387 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:16.211448 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.217726 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:16.228000 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-602d2997-f483-4ac5-8da9-89f665dd9ef8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1498 microversion: 2.1 time: 0.558364 Sep 08 16:21:16.235552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 321/670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:15 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1498 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:16.307127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:16.309477 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:16.325750 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.326875 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:16.328649 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.330254 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:16.466753 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lazy-loading 'flavor' on Instance uuid 0a3b840e-551f-45cd-bbb8-079394ec0f1a {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:21:16.701156 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e5733ca9-9ea8-47c4-84dd-b22e50e290b9 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "POST /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a/action" status: 202 len: 0 microversion: 2.1 time: 0.400563 Sep 08 16:21:16.708271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 322/671] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:16 2021] POST /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:16.728113 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:16.730754 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:16.766451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:16.767878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.768459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:16.774468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.775136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:16.784147 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4763ef13-3d98-48cb-9a31-fde2bb402926 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.600431 Sep 08 16:21:16.786320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 350/672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:16 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:16.798107 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-71eca695-9927-41df-b539-83bea0fc304a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:16.809283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-71eca695-9927-41df-b539-83bea0fc304a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:16.840066 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71eca695-9927-41df-b539-83bea0fc304a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.840597 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71eca695-9927-41df-b539-83bea0fc304a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:16.843004 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71eca695-9927-41df-b539-83bea0fc304a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:16.843507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71eca695-9927-41df-b539-83bea0fc304a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:17.033332 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-71eca695-9927-41df-b539-83bea0fc304a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 28437 microversion: 2.20 time: 0.245019 Sep 08 16:21:17.034111 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 351/673] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:16 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 28437 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:17.493149 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:17.494198 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:17.527947 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:17.528395 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:17.529301 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:17.530496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:17.593941 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:17.602598 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:21:17.608463 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5035cd7e-3fe3-4d93-8d1e-59d72ba8a3f7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.892912 Sep 08 16:21:17.609153 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 323/674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:16 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:17.777933 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a62d3308-06bd-4492-a3d8-a4ba8cc4fd81 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 204 len: 0 microversion: 2.1 time: 0.294433 Sep 08 16:21:17.783602 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 352/675] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:21:17 2021] DELETE /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:21:17.787899 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:17.788777 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:17.801193 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:17.804472 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:17.805332 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:17.805590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:17.806596 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:17.808402 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:17.825544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:17.826316 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:17.828356 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:17.829367 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:18.497776 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:18.522071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-544c3113-3081-48c8-be9b-44f565324af2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1504 microversion: 2.1 time: 0.737849 Sep 08 16:21:18.531981 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 324/676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:17 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1504 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:18.539024 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:18.544484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4748129a-febf-4ce0-a2a9-02f71bed026c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:18.545632 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4748129a-febf-4ce0-a2a9-02f71bed026c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:18.553251 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2b87bb33-7ba5-4e51-8975-ce4f9eaf8fc5 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.754450 Sep 08 16:21:18.553758 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 353/677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:17 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:18.565480 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4748129a-febf-4ce0-a2a9-02f71bed026c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:18.567407 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4748129a-febf-4ce0-a2a9-02f71bed026c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:18.568573 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4748129a-febf-4ce0-a2a9-02f71bed026c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:18.569957 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4748129a-febf-4ce0-a2a9-02f71bed026c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:18.629410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:18.630499 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:18.659292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:18.663713 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:18.674168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:18.681088 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:18.953339 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4748129a-febf-4ce0-a2a9-02f71bed026c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 28604 microversion: 2.20 time: 0.417910 Sep 08 16:21:18.955246 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 325/678] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:18 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 28604 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:18.972115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-5efe56b2-03ec-4e31-a89d-ab739bb48ddf req-5f1f69b4-6900-43ee-b671-f404e5e7b527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8663ba-2359-4629-850a-16db3a5e3798", "tag": "d1d984fb-70ca-4008-b36b-e027b27472de"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:18.988264 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:18.988264 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:19.010845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-5efe56b2-03ec-4e31-a89d-ab739bb48ddf req-5f1f69b4-6900-43ee-b671-f404e5e7b527 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:19.013147 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-5efe56b2-03ec-4e31-a89d-ab739bb48ddf req-5f1f69b4-6900-43ee-b671-f404e5e7b527 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:19.085467 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-5efe56b2-03ec-4e31-a89d-ab739bb48ddf req-5f1f69b4-6900-43ee-b671-f404e5e7b527 service nova] Creating event network-changed:d1d984fb-70ca-4008-b36b-e027b27472de for instance 2a8663ba-2359-4629-850a-16db3a5e3798 on hv-cinder-80789 Sep 08 16:21:19.101951 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-5efe56b2-03ec-4e31-a89d-ab739bb48ddf req-5f1f69b4-6900-43ee-b671-f404e5e7b527 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143725 Sep 08 16:21:19.104792 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 326/679] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:19.466292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:19.479730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d1308f88-1f49-4ce4-ab75-41516d76fb46 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.856738 Sep 08 16:21:19.483458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 354/680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:18 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:19.546073 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:19.550914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:19.575262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:19.576654 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:19.598411 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:19.599363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:19.605147 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:19.606098 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:19.614567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:19.619440 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:19.623362 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:19.624747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:21.148627 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:21.161868 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-910f9f71-27d1-4543-89f5-e9a984f8ddca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1504 microversion: 2.1 time: 1.624065 Sep 08 16:21:21.167571 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 327/681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:19 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1504 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:21.169912 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:21.179592 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fdaf1eed-ec88-424b-9202-88589f7d006b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:21.182830 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fdaf1eed-ec88-424b-9202-88589f7d006b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:21.191402 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8fcb31f3-b21b-44f1-9d9a-0c493221857f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 1.620211 Sep 08 16:21:21.192145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 355/682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:19 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:21.200990 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fdaf1eed-ec88-424b-9202-88589f7d006b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:21.207303 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fdaf1eed-ec88-424b-9202-88589f7d006b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:21.208204 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:21.208834 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:21.209080 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fdaf1eed-ec88-424b-9202-88589f7d006b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:21.209709 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fdaf1eed-ec88-424b-9202-88589f7d006b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:21.229477 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:21.229926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:21.231896 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:21.233612 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:21.381612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fdaf1eed-ec88-424b-9202-88589f7d006b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 28604 microversion: 2.20 time: 0.211464 Sep 08 16:21:21.388669 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 328/683] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:21 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 28604 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:22.004932 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-7c7b0e17-563e-46fd-9cc3-f3013ecf654f req-3951b49a-3f0c-410f-bb1d-432a3c0c043e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4e7159-bfde-4aca-bb0b-b059f6980e77", "name": "network-vif-deleted", "tag": "e6f8642b-2e45-416d-a08c-643ab2581966"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:22.015599 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:22.015599 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:22.051163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-7c7b0e17-563e-46fd-9cc3-f3013ecf654f req-3951b49a-3f0c-410f-bb1d-432a3c0c043e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:22.053120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-7c7b0e17-563e-46fd-9cc3-f3013ecf654f req-3951b49a-3f0c-410f-bb1d-432a3c0c043e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:22.096716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-7c7b0e17-563e-46fd-9cc3-f3013ecf654f req-3951b49a-3f0c-410f-bb1d-432a3c0c043e service nova] Creating event network-vif-deleted:e6f8642b-2e45-416d-a08c-643ab2581966 for instance 6e4e7159-bfde-4aca-bb0b-b059f6980e77 on hv-cinder-80789 Sep 08 16:21:22.109111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-7c7b0e17-563e-46fd-9cc3-f3013ecf654f req-3951b49a-3f0c-410f-bb1d-432a3c0c043e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120400 Sep 08 16:21:22.112459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 329/684] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:22.156825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:22.171259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d931d561-7c53-4fe0-ae13-79a05b32d22b tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.977849 Sep 08 16:21:22.175507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 356/685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:21 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:22.184563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:22.184563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:22.200048 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:22.200605 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:22.201505 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:22.202017 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:22.209539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:22.210154 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:22.226806 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:22.227256 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:22.230291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:22.230963 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:22.536166 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:22.560508 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-43e822bd-7fad-4a96-bbc1-1abed7404f7c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 200 len: 1299 microversion: 2.1 time: 0.384542 Sep 08 16:21:22.562034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 330/686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:22 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 1299 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:22.569453 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cb4b62b2-454b-4338-a7c3-1ae5e687cef8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:22.570700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cb4b62b2-454b-4338-a7c3-1ae5e687cef8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:22.589632 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cb4b62b2-454b-4338-a7c3-1ae5e687cef8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:22.590665 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cb4b62b2-454b-4338-a7c3-1ae5e687cef8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:22.592288 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cb4b62b2-454b-4338-a7c3-1ae5e687cef8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:22.594060 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cb4b62b2-454b-4338-a7c3-1ae5e687cef8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:22.744249 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:22.776337 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d5c3b015-747a-4945-b224-11cede1c90bf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.564783 Sep 08 16:21:22.777784 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 357/687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:22 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:22.908807 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cb4b62b2-454b-4338-a7c3-1ae5e687cef8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 30123 microversion: 2.20 time: 0.342046 Sep 08 16:21:22.910270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 331/688] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:22 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 30123 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:23.197918 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:23.213973 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:23.256023 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.256466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:23.257954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.258397 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:23.602442 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:23.603613 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: 6e4e7159-bfde-4aca-bb0b-b059f6980e77] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:23.627134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:23.639378 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.640185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:23.641576 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.643293 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:23.646825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6e10a26a-00ab-4326-ae01-bbb4a6f627e6 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.457005 Sep 08 16:21:23.649954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 358/689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:23 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:23.771500 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] HTTP exception thrown: Instance 6e4e7159-bfde-4aca-bb0b-b059f6980e77 could not be found. Sep 08 16:21:23.777764 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Returning 404 to user: Instance 6e4e7159-bfde-4aca-bb0b-b059f6980e77 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:21:23.779120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-759bb25b-2a55-4012-a636-bbbe2178858f tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77" status: 404 len: 111 microversion: 2.1 time: 0.192173 Sep 08 16:21:23.779954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 332/690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:23 2021] GET /compute/v2.1/servers/6e4e7159-bfde-4aca-bb0b-b059f6980e77 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:21:23.815445 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:23.816508 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:23.833369 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.834506 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:23.836168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.837134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:23.937673 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ff760f9a-4d5a-4afc-8045-029c6721c054 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:23.940855 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ff760f9a-4d5a-4afc-8045-029c6721c054 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:23.976978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff760f9a-4d5a-4afc-8045-029c6721c054 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.977839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff760f9a-4d5a-4afc-8045-029c6721c054 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:23.980889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff760f9a-4d5a-4afc-8045-029c6721c054 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:23.985246 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff760f9a-4d5a-4afc-8045-029c6721c054 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:24.278342 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ff760f9a-4d5a-4afc-8045-029c6721c054 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 32225 microversion: 2.20 time: 0.349155 Sep 08 16:21:24.280528 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 333/691] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:23 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 32225 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:24.290452 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-864530578", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "2387d553-0a72-48c0-a9df-0fcfa0f93147"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:24.424955 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] validate_networks() for [('2387d553-0a72-48c0-a9df-0fcfa0f93147', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:21:24.622641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:24.644717 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ccd93cf6-47e4-4588-b30b-c3384a409582 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.833879 Sep 08 16:21:24.646767 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 359/692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:23 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:24.679575 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:24.681338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:24.706617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:24.710404 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:24.712092 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:24.713022 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:25.351005 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:21:25.351802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:21:25.352522 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:21:25.353035 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:21:25.353553 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:21:25.369812 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:25.374090 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:25.376540 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:25.381007 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:25.381853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:25.396038 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fded9404-824a-49dd-9c68-f47d23660a60 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.730659 Sep 08 16:21:25.408566 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 360/693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:24 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:25.420152 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Getting quotas for project 633ffbd0760e4ad69bef0e867ad6c4b9. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:21:25.424143 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-48777b40-1a89-4009-be8e-95c08eceb1f9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:25.425942 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-48777b40-1a89-4009-be8e-95c08eceb1f9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:25.427271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Getting quotas for user dc3811fbb13d4488bd68feafdb8da149 and project 633ffbd0760e4ad69bef0e867ad6c4b9. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:21:25.439853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48777b40-1a89-4009-be8e-95c08eceb1f9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:25.441165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48777b40-1a89-4009-be8e-95c08eceb1f9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:25.442826 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48777b40-1a89-4009-be8e-95c08eceb1f9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:25.443866 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48777b40-1a89-4009-be8e-95c08eceb1f9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:25.445267 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:21:25.447990 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:21:25.524901 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-05602ee5-3f46-4d0d-bbc1-cd2179db9cc2 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242688 Sep 08 16:21:25.532334 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 334/694] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:21:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:21:25.539818 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-bea6c4d4-bc12-4d61-a13c-a4e4c962877c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:25.540563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-bea6c4d4-bc12-4d61-a13c-a4e4c962877c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:25.702387 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-bea6c4d4-bc12-4d61-a13c-a4e4c962877c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:25.713925 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-48777b40-1a89-4009-be8e-95c08eceb1f9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 33429 microversion: 2.20 time: 0.302953 Sep 08 16:21:25.716309 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-bea6c4d4-bc12-4d61-a13c-a4e4c962877c tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1213 microversion: 2.1 time: 0.182030 Sep 08 16:21:25.717474 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 335/695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:25 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:25.725596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 361/696] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:25 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 33429 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:25.734976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:25.735835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:25.746119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:25.746839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:25.748007 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:25.748572 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:26.224659 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:26.237729 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8333aa60-0b5b-4b94-9098-b49c978f7765 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.506614 Sep 08 16:21:26.238625 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 336/697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:25 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:26.449544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:26.455752 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:26.483135 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:26.493528 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:26.495917 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:26.497022 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:26.740847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-25037855-13dc-411b-8438-6d75d8f5f7f1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:26.743182 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-25037855-13dc-411b-8438-6d75d8f5f7f1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:26.764523 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-25037855-13dc-411b-8438-6d75d8f5f7f1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:26.765494 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-25037855-13dc-411b-8438-6d75d8f5f7f1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:26.767075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-25037855-13dc-411b-8438-6d75d8f5f7f1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:26.768185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-25037855-13dc-411b-8438-6d75d8f5f7f1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:27.004385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:27.028411 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0bbf47bc-4f1f-4ffe-8bce-6c5967ab09bf tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.606180 Sep 08 16:21:27.031095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 362/698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:26 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:27.061446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:27.061877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-25037855-13dc-411b-8438-6d75d8f5f7f1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 34880 microversion: 2.20 time: 0.331129 Sep 08 16:21:27.063206 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 337/699] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:26 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 34880 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:21:27.064829 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:27.084428 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:27.085512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:27.087098 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:27.087999 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:27.271697 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:27.275002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:27.315898 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:27.317018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:27.318541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:27.319782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:27.336146 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:27.367570 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3b10ebca-8221-4348-a498-042cebc593b6 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1265 microversion: 2.1 time: 0.333364 Sep 08 16:21:27.388142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 363/700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:27 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:27.957071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:28.002385 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b1b2dabc-1b06-4a06-b99f-ef0962fc962f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.734807 Sep 08 16:21:28.005292 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 338/701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:27 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:28.061923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:28.064749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:28.081920 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d3f50f87-4dd5-4c65-ab39-526442dd0163 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:28.087020 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d3f50f87-4dd5-4c65-ab39-526442dd0163 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:28.111715 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d3f50f87-4dd5-4c65-ab39-526442dd0163 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:28.112515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d3f50f87-4dd5-4c65-ab39-526442dd0163 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:28.113967 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d3f50f87-4dd5-4c65-ab39-526442dd0163 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:28.114695 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d3f50f87-4dd5-4c65-ab39-526442dd0163 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:28.115034 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:28.116261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:28.118344 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:28.119360 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:28.427196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d3f50f87-4dd5-4c65-ab39-526442dd0163 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 36717 microversion: 2.20 time: 0.352116 Sep 08 16:21:28.435842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 339/702] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:28 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 36717 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:28.615105 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:28.640576 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-05e19fe4-096b-4e7f-b4ac-a13ae2743c65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.585414 Sep 08 16:21:28.656419 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 364/703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:28 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:28.671823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:28.674076 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:28.691730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:28.693254 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:28.695276 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:28.696814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:28.743093 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-362799a5-4dc0-4eef-9273-3e701d6e64e2 req-e7234f65-e85a-41e7-9020-6707bac21a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8663ba-2359-4629-850a-16db3a5e3798", "name": "network-vif-plugged", "status": "completed", "tag": "d1d984fb-70ca-4008-b36b-e027b27472de"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:28.746522 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:28.746522 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:28.763590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-362799a5-4dc0-4eef-9273-3e701d6e64e2 req-e7234f65-e85a-41e7-9020-6707bac21a42 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:28.765073 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-362799a5-4dc0-4eef-9273-3e701d6e64e2 req-e7234f65-e85a-41e7-9020-6707bac21a42 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:28.797812 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-362799a5-4dc0-4eef-9273-3e701d6e64e2 req-e7234f65-e85a-41e7-9020-6707bac21a42 service nova] Creating event network-vif-plugged:d1d984fb-70ca-4008-b36b-e027b27472de for instance 2a8663ba-2359-4629-850a-16db3a5e3798 on hv-cinder-80789 Sep 08 16:21:28.816614 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-362799a5-4dc0-4eef-9273-3e701d6e64e2 req-e7234f65-e85a-41e7-9020-6707bac21a42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377633 Sep 08 16:21:28.818715 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 340/704] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:28.960567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:28.977614 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-78bad958-d47f-4921-a206-ff94a6e56695 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1271 microversion: 2.1 time: 0.312760 Sep 08 16:21:28.979063 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 365/705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:28 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:29.035607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:29.038144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:29.056299 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:29.057129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:29.060272 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:29.062157 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:29.445536 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-847c63cc-bb9c-4aae-9501-b9b1cfc92051 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:29.448077 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-847c63cc-bb9c-4aae-9501-b9b1cfc92051 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:29.451054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:29.474532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-847c63cc-bb9c-4aae-9501-b9b1cfc92051 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:29.475986 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-847c63cc-bb9c-4aae-9501-b9b1cfc92051 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:29.476965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f076731e-725c-499b-934b-908242606a9f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.449159 Sep 08 16:21:29.477386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-847c63cc-bb9c-4aae-9501-b9b1cfc92051 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:29.478124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-847c63cc-bb9c-4aae-9501-b9b1cfc92051 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:29.479336 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 341/706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:29 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:29.672496 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:29.674563 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:29.691142 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:29.692078 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:29.696279 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:29.697178 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:29.820768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-847c63cc-bb9c-4aae-9501-b9b1cfc92051 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 38162 microversion: 2.20 time: 0.380434 Sep 08 16:21:29.822795 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 366/707] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:29 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 38162 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:21:30.018480 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:30.020576 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:30.069384 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:30.072019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:30.072565 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:30.080507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:30.081390 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:30.093112 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d78d8924-ae6b-4b8d-9a1a-0bdf5c6ca419 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.425560 Sep 08 16:21:30.094420 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 342/708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:29 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:30.282354 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:30.294363 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6433aa72-ebf0-4ba8-82d9-350f17bf0b83 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1271 microversion: 2.1 time: 0.290038 Sep 08 16:21:30.294363 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 367/709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:30 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:30.501980 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:30.503395 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:30.536466 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:30.537289 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:30.541465 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:30.542285 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:30.840140 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5b1a4301-2c17-4a20-9e41-d15f706b8844 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:30.841807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5b1a4301-2c17-4a20-9e41-d15f706b8844 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:30.880169 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b1a4301-2c17-4a20-9e41-d15f706b8844 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:30.889630 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b1a4301-2c17-4a20-9e41-d15f706b8844 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:30.891609 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b1a4301-2c17-4a20-9e41-d15f706b8844 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:30.904624 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b1a4301-2c17-4a20-9e41-d15f706b8844 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:31.161831 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5b1a4301-2c17-4a20-9e41-d15f706b8844 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 38162 microversion: 2.20 time: 0.328722 Sep 08 16:21:31.168596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 368/710] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:30 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 38162 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:31.192567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:31.193847 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:31.244062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:31.249696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:31.253649 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:31.256749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:31.365984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:31.400430 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-893934a2-cf72-4208-a28b-1fc0b708ac8b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1363 microversion: 2.1 time: 0.906182 Sep 08 16:21:31.401460 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 343/711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:30 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1363 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:31.461823 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:31.463411 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:31.504300 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:31.504757 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:31.511680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:31.512144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:31.763832 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:31.777849 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fb8a3433-fb61-4d55-9b27-a2793a76724c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.610960 Sep 08 16:21:31.791427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 369/712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:31 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:32.054082 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:32.092443 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-922bf641-2293-4912-8f7b-850ca982a2e3 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.660308 Sep 08 16:21:32.097058 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 344/713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:31 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:32.182451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7d38ae69-72b3-4219-8207-7cfb96884219 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:32.184028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7d38ae69-72b3-4219-8207-7cfb96884219 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:32.217962 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d38ae69-72b3-4219-8207-7cfb96884219 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:32.219029 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d38ae69-72b3-4219-8207-7cfb96884219 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:32.221410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d38ae69-72b3-4219-8207-7cfb96884219 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:32.227871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d38ae69-72b3-4219-8207-7cfb96884219 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:32.432973 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:32.433983 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:32.460749 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:32.466598 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:32.468844 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:32.469905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:32.474188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7d38ae69-72b3-4219-8207-7cfb96884219 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 38162 microversion: 2.20 time: 0.298760 Sep 08 16:21:32.476100 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 370/714] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:32 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 38162 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:32.813008 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:32.822542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:32.890825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:32.892725 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:32.894602 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:32.900895 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:32.951645 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:32.991377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8ee9a9c8-c103-41c9-b0b7-8f6dfaf9c83a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1548 microversion: 2.1 time: 0.563388 Sep 08 16:21:32.999154 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 345/715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:32 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1548 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:33.027680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-189e0a44-244b-4bc6-ac59-8479851e06cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:33.028549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-189e0a44-244b-4bc6-ac59-8479851e06cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:33.056656 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-189e0a44-244b-4bc6-ac59-8479851e06cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:33.057680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-189e0a44-244b-4bc6-ac59-8479851e06cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:33.059298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-189e0a44-244b-4bc6-ac59-8479851e06cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:33.061018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-189e0a44-244b-4bc6-ac59-8479851e06cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:33.860621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-189e0a44-244b-4bc6-ac59-8479851e06cb tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.842613 Sep 08 16:21:33.864244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 346/716] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Sep 8 16:21:33 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-interface => generated 284 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:33.873536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:33.874950 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:33.890902 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:33.892138 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:33.893949 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:33.895083 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:33.989148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:34.018654 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b2a5ea7d-1694-4b19-b757-1865c830ecca tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 1.222290 Sep 08 16:21:34.020347 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 371/717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:32 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:34.037747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-637cdb4e-3bf1-414e-b491-bc324db024ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:34.039914 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-637cdb4e-3bf1-414e-b491-bc324db024ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:34.060095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-637cdb4e-3bf1-414e-b491-bc324db024ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:34.060991 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-637cdb4e-3bf1-414e-b491-bc324db024ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:34.062515 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-637cdb4e-3bf1-414e-b491-bc324db024ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:34.063341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-637cdb4e-3bf1-414e-b491-bc324db024ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:34.330030 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-637cdb4e-3bf1-414e-b491-bc324db024ca tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 200 len: 38305 microversion: 2.20 time: 0.306455 Sep 08 16:21:34.340522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 372/718] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:34 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 38305 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:21:34.364283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-48d80ee3-566e-4c57-b2a5-1e393758497e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:34.365387 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-48d80ee3-566e-4c57-b2a5-1e393758497e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:34.391600 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48d80ee3-566e-4c57-b2a5-1e393758497e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:34.392219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48d80ee3-566e-4c57-b2a5-1e393758497e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:34.393031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48d80ee3-566e-4c57-b2a5-1e393758497e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:34.393469 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-48d80ee3-566e-4c57-b2a5-1e393758497e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:34.528978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:34.578300 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-67d148a3-9be8-459b-8c9c-adb9a04fcfc1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.708919 Sep 08 16:21:34.595417 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 347/719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:33 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:34.631168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-48d80ee3-566e-4c57-b2a5-1e393758497e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/ips" status: 200 len: 152 microversion: 2.20 time: 0.286422 Sep 08 16:21:34.632555 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 373/720] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Sep 8 16:21:34 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/ips => generated 152 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:35.047302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:35.053011 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:35.094825 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:35.096232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:35.104800 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:35.105963 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:35.168936 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-06bc100a-b7b1-4cf3-a4aa-ab10415cb90d req-77096689-fb40-4a5e-bc69-9f05fc3faef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba6c642-aaa3-47c7-82a7-b2190f9266be", "tag": "933933a1-91b4-4222-abf0-80b0f7c6437c"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:35.180223 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:35.180223 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:21:35.235291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-06bc100a-b7b1-4cf3-a4aa-ab10415cb90d req-77096689-fb40-4a5e-bc69-9f05fc3faef5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:35.236937 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-06bc100a-b7b1-4cf3-a4aa-ab10415cb90d req-77096689-fb40-4a5e-bc69-9f05fc3faef5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:35.326880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-06bc100a-b7b1-4cf3-a4aa-ab10415cb90d req-77096689-fb40-4a5e-bc69-9f05fc3faef5 service nova] Creating event network-changed:933933a1-91b4-4222-abf0-80b0f7c6437c for instance cba6c642-aaa3-47c7-82a7-b2190f9266be on hv-cinder-80789 Sep 08 16:21:35.358378 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-06bc100a-b7b1-4cf3-a4aa-ab10415cb90d req-77096689-fb40-4a5e-bc69-9f05fc3faef5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196558 Sep 08 16:21:35.359941 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 374/721] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:35.635449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:35.642713 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:35.679862 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:35.683748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:35.687846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:35.692144 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:36.070342 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:36.099418 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9bb5bf9e-b02a-437b-86e9-6d4438c5308d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1569 microversion: 2.1 time: 1.065724 Sep 08 16:21:36.108716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 348/722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:35 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1569 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:36.139997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-54d19125-d84b-48a7-b31c-84ee0765d4ef tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:36.140905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-54d19125-d84b-48a7-b31c-84ee0765d4ef tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:36.163112 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54d19125-d84b-48a7-b31c-84ee0765d4ef tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:36.177454 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54d19125-d84b-48a7-b31c-84ee0765d4ef tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:36.179570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54d19125-d84b-48a7-b31c-84ee0765d4ef tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:36.180216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-54d19125-d84b-48a7-b31c-84ee0765d4ef tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:36.453206 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:36.490915 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-13f84222-c869-4ef4-8c78-96242cb69078 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.868039 Sep 08 16:21:36.509844 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 375/723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:35 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:36.616755 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-54d19125-d84b-48a7-b31c-84ee0765d4ef tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "POST /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a/action" status: 202 len: 0 microversion: 2.1 time: 0.481019 Sep 08 16:21:36.618193 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 349/724] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:36 2021] POST /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:21:36.631552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:36.634362 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:36.678210 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:36.679253 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:36.680798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:36.688242 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:37.526969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:37.528363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:37.536351 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:37.540630 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:37.551032 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:37.552139 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:37.554624 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:37.577075 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b33d6a61-7e1d-4b68-85db-714ffa1574fd tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1517 microversion: 2.1 time: 0.952290 Sep 08 16:21:37.594610 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 376/725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:36 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1517 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:37.670128 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-dbf7f39b-dfe6-4da1-ad9d-aa8763060de5 req-623fc1f2-da94-46f2-bec9-d081f9fb9b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3b840e-551f-45cd-bbb8-079394ec0f1a", "name": "network-vif-unplugged", "status": "completed", "tag": "6d93681d-822b-4cdf-8b2f-08faccca27db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:37.682203 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:37.682203 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:21:37.756469 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-dbf7f39b-dfe6-4da1-ad9d-aa8763060de5 req-623fc1f2-da94-46f2-bec9-d081f9fb9b3b service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:37.757271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-dbf7f39b-dfe6-4da1-ad9d-aa8763060de5 req-623fc1f2-da94-46f2-bec9-d081f9fb9b3b service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:37.865345 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.compute.server_external_events [req-dbf7f39b-dfe6-4da1-ad9d-aa8763060de5 req-623fc1f2-da94-46f2-bec9-d081f9fb9b3b service nova] Unable to find a host for instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a. Dropping event network-vif-unplugged {{(pid=93618) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 08 16:21:37.866929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-dbf7f39b-dfe6-4da1-ad9d-aa8763060de5 req-623fc1f2-da94-46f2-bec9-d081f9fb9b3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.210126 Sep 08 16:21:37.880824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 377/726] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 226 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 16:21:38.367798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:38.431770 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9ffa9864-0fb3-4326-a33a-1f186ca13e8e tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.902350 Sep 08 16:21:38.433164 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 350/727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:37 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:38.608358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:38.609428 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:38.656945 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:38.658672 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:38.664623 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:38.665748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:39.197451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:39.200376 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:39.240792 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:39.241545 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:39.253216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:39.256212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:39.476195 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lazy-loading 'flavor' on Instance uuid 1c5fbdd8-f58c-4d16-be45-d9003f0e770c {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:21:39.555113 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:39.578090 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a43fcaa8-f7c3-41a3-a3e0-a5bdd17d1f9c tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1519 microversion: 2.1 time: 0.974474 Sep 08 16:21:39.591509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 378/728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:38 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1519 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:39.591509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:39.592125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:39.618104 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:39.619312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:39.621132 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:39.622178 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:40.175514 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:40.201358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-40237c17-5113-41e7-b807-c798657223bb tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.619160 Sep 08 16:21:40.220583 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 379/729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:39 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:40.481086 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e289b57e-632e-4553-8f35-be25bf6ff2a3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 202 len: 0 microversion: 2.20 time: 1.289523 Sep 08 16:21:40.488858 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 351/730] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:21:39 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 0 bytes in 1297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:21:40.498715 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:40.500445 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:40.515658 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:40.519979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:40.522061 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:40.523062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:40.616113 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:40.617691 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:40.635541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:40.636572 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:40.638219 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:40.639298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:41.070480 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:41.106588 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:41.126964 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:41.135807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a4f57c9d-72d4-40fb-965b-3f09e6cd5527 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.642372 Sep 08 16:21:41.143156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 380/731] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:40 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:41.160309 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9973f363-84e9-4c7b-8598-6f4b0e3808d1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:41.162136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9973f363-84e9-4c7b-8598-6f4b0e3808d1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:41.194498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9973f363-84e9-4c7b-8598-6f4b0e3808d1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:41.195288 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9973f363-84e9-4c7b-8598-6f4b0e3808d1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:41.202390 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9973f363-84e9-4c7b-8598-6f4b0e3808d1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:41.203084 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9973f363-84e9-4c7b-8598-6f4b0e3808d1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:41.279669 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:41.292841 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0f1b7e4e-8a27-4d95-ac5c-f01db0ebd365 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.686141 Sep 08 16:21:41.310067 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 352/732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:40 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:41.315876 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-bd0c1773-0092-4cda-b439-1d534d70507d req-3866b99a-41fb-41c2-beb8-54c4d868969f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8663ba-2359-4629-850a-16db3a5e3798", "tag": "d1d984fb-70ca-4008-b36b-e027b27472de"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:41.317847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:41.317847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:41.328163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-bd0c1773-0092-4cda-b439-1d534d70507d req-3866b99a-41fb-41c2-beb8-54c4d868969f service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:41.328907 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-bd0c1773-0092-4cda-b439-1d534d70507d req-3866b99a-41fb-41c2-beb8-54c4d868969f service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:41.353897 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-bd0c1773-0092-4cda-b439-1d534d70507d req-3866b99a-41fb-41c2-beb8-54c4d868969f service nova] Creating event network-changed:d1d984fb-70ca-4008-b36b-e027b27472de for instance 2a8663ba-2359-4629-850a-16db3a5e3798 on hv-cinder-80789 Sep 08 16:21:41.360151 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-bd0c1773-0092-4cda-b439-1d534d70507d req-3866b99a-41fb-41c2-beb8-54c4d868969f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048064 Sep 08 16:21:41.362828 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 353/733] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:41.368920 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:41.370009 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:41.375426 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9973f363-84e9-4c7b-8598-6f4b0e3808d1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 14 microversion: 2.1 time: 0.230314 Sep 08 16:21:41.376768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 381/734] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:41 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:21:41.380827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:41.382123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:41.383461 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:41.384112 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:41.990412 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:42.012494 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7497a7bb-4992-41a5-927c-cb5384aaf16a tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.641267 Sep 08 16:21:42.013590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 354/735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:41 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:42.174507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:42.175744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:42.216106 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:42.216368 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:42.217618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:42.218406 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:42.321547 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:42.322997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:42.353805 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:42.354587 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:42.356068 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:42.356847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:43.012556 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:43.052690 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:43.054508 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:43.055948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c5c2bfc3-baf4-4b2b-bc8b-b97e6861cd78 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.889716 Sep 08 16:21:43.056618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 382/736] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:42 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:43.061765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-67ab4bfe-9b29-4534-9b00-1b2f6e1a095f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:43.062990 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-67ab4bfe-9b29-4534-9b00-1b2f6e1a095f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:43.072772 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67ab4bfe-9b29-4534-9b00-1b2f6e1a095f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:43.073579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67ab4bfe-9b29-4534-9b00-1b2f6e1a095f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:43.074516 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67ab4bfe-9b29-4534-9b00-1b2f6e1a095f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:43.075057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-67ab4bfe-9b29-4534-9b00-1b2f6e1a095f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:43.271547 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-67ab4bfe-9b29-4534-9b00-1b2f6e1a095f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 2807 microversion: 2.1 time: 0.212852 Sep 08 16:21:43.272821 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 383/737] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:43 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 2807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:43.315579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:43.317092 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:43.318122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:43.344038 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-be374bbb-ac3c-429b-9227-14d754aaddde tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 1.031104 Sep 08 16:21:43.346663 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 355/738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:42 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:43.363309 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:43.374874 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:43.376429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:43.377185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:43.854740 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:43.873558 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ede42076-cb64-4789-a7bb-b5cf6db9ef33 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.598235 Sep 08 16:21:43.874939 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 384/739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:43 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:44.077393 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:44.078333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:44.088349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.089113 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:44.090276 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.090924 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:44.285709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1672bf04-9ba9-4c9e-9985-1f7c799ecc19 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:44.286807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1672bf04-9ba9-4c9e-9985-1f7c799ecc19 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:44.301987 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1672bf04-9ba9-4c9e-9985-1f7c799ecc19 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.302497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1672bf04-9ba9-4c9e-9985-1f7c799ecc19 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:44.316679 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1672bf04-9ba9-4c9e-9985-1f7c799ecc19 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.316679 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1672bf04-9ba9-4c9e-9985-1f7c799ecc19 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:44.459191 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:44.487912 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:44.490278 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:44.491494 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-aad6bd12-8f85-4192-8bd6-9b5ab12b3298 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.417942 Sep 08 16:21:44.502202 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 356/740] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:44 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:44.502202 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:44.502202 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:44.509164 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.509668 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:44.510455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.510888 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:44.570055 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1672bf04-9ba9-4c9e-9985-1f7c799ecc19 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 15025 microversion: 2.1 time: 0.290112 Sep 08 16:21:44.571304 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 385/741] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:44 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 15025 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:44.804919 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:44.822798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1c5cdae7-0ccb-4288-8292-afec56393d4d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.329165 Sep 08 16:21:44.823724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 357/742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:44 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:44.906484 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:44.908593 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:44.923935 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.926160 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:44.927729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:44.928383 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.263056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:45.281653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ff2be741-68e2-42e9-ba3e-ce92ec8719e7 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.381755 Sep 08 16:21:45.283308 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 386/743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:44 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:45.511950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:45.513107 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:45.515054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-084a013a-02c2-480c-b14b-216ac4f5c964 req-0e858b90-76bb-4628-8525-e4b95b6a2ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba6c642-aaa3-47c7-82a7-b2190f9266be", "name": "network-vif-plugged", "status": "completed", "tag": "933933a1-91b4-4222-abf0-80b0f7c6437c"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:45.521034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:45.521034 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:45.534679 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:45.535162 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.536272 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:45.536899 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.537706 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-084a013a-02c2-480c-b14b-216ac4f5c964 req-0e858b90-76bb-4628-8525-e4b95b6a2ca0 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:45.538830 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-084a013a-02c2-480c-b14b-216ac4f5c964 req-0e858b90-76bb-4628-8525-e4b95b6a2ca0 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.575207 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-084a013a-02c2-480c-b14b-216ac4f5c964 req-0e858b90-76bb-4628-8525-e4b95b6a2ca0 service nova] Creating event network-vif-plugged:933933a1-91b4-4222-abf0-80b0f7c6437c for instance cba6c642-aaa3-47c7-82a7-b2190f9266be on hv-cinder-80789 Sep 08 16:21:45.622055 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-084a013a-02c2-480c-b14b-216ac4f5c964 req-0e858b90-76bb-4628-8525-e4b95b6a2ca0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118671 Sep 08 16:21:45.623425 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 358/744] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:45.629660 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b6729f2e-79e4-4a04-b339-df2d7be8d0a1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:45.631075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b6729f2e-79e4-4a04-b339-df2d7be8d0a1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:45.640083 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b6729f2e-79e4-4a04-b339-df2d7be8d0a1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:45.640826 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b6729f2e-79e4-4a04-b339-df2d7be8d0a1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.642088 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b6729f2e-79e4-4a04-b339-df2d7be8d0a1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:45.646820 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b6729f2e-79e4-4a04-b339-df2d7be8d0a1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.875299 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b6729f2e-79e4-4a04-b339-df2d7be8d0a1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 18608 microversion: 2.1 time: 0.249677 Sep 08 16:21:45.877681 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 359/745] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:45 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 18608 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:45.890658 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:45.892558 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:45.910577 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:45.911881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.913747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:45.915100 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:45.973021 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:46.010612 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:46.023825 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:46.029954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-281c59d0-ebec-486f-b57a-564facc32772 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.522998 Sep 08 16:21:46.035659 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 387/746] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:45 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:21:46.309606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:46.311234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:46.327360 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:46.328436 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:46.329598 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:46.331644 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:46.382880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:46.411595 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-00ed9a8c-dfac-4348-8843-6e305a93cf35 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.531133 Sep 08 16:21:46.427646 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 360/747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:45 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:46.656895 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:46.670984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2f36b944-4ed0-406d-a901-2a4af2d22351 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1313 microversion: 2.1 time: 0.374626 Sep 08 16:21:46.676875 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 388/748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:46 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:46.889854 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-66a761a3-daab-4fa0-969f-648ec97cb5c7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:46.891567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-66a761a3-daab-4fa0-969f-648ec97cb5c7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:46.904068 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66a761a3-daab-4fa0-969f-648ec97cb5c7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:46.904960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66a761a3-daab-4fa0-969f-648ec97cb5c7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:46.905995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66a761a3-daab-4fa0-969f-648ec97cb5c7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:46.906643 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-66a761a3-daab-4fa0-969f-648ec97cb5c7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:47.052215 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:47.052849 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:47.063635 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:47.064222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:47.065089 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:47.065540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:47.078148 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-66a761a3-daab-4fa0-969f-648ec97cb5c7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 20148 microversion: 2.1 time: 0.191547 Sep 08 16:21:47.086106 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 361/749] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:46 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 20148 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:21:47.331314 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:47.350967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:47.354150 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:47.356135 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9cd91155-babb-460e-923e-ef57b406966b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.308276 Sep 08 16:21:47.357041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 389/750] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:47 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:47.449491 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:47.450707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:47.469065 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:47.470716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:47.471983 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:47.472723 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:47.701819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:47.704168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:47.748872 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:47.755410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:47.757231 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:47.758045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:47.923213 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:47.943451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9a09d45b-021a-4564-93de-38765a86fe1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.507683 Sep 08 16:21:47.945009 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 362/751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:47 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:48.098713 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f4bc6dc4-d361-4d13-9db0-740358b088a7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:48.100334 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f4bc6dc4-d361-4d13-9db0-740358b088a7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:48.117142 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f4bc6dc4-d361-4d13-9db0-740358b088a7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:48.117883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f4bc6dc4-d361-4d13-9db0-740358b088a7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:48.119425 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f4bc6dc4-d361-4d13-9db0-740358b088a7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:48.120185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f4bc6dc4-d361-4d13-9db0-740358b088a7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:48.330129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f4bc6dc4-d361-4d13-9db0-740358b088a7 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 22716 microversion: 2.1 time: 0.238967 Sep 08 16:21:48.331392 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 363/752] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:48 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 22716 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:48.387946 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:48.389435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:48.400124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:48.419698 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ec93ccc3-c500-4571-92e2-318314335f0d tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1497 microversion: 2.1 time: 0.726224 Sep 08 16:21:48.427782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:48.428698 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:48.430240 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:48.431419 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 390/753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:47 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1497 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:48.432106 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:48.838435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:48.867982 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:48.870970 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:48.885719 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d308ffd9-a7bb-4cb4-a6cb-07c1a84dbdfc tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.505680 Sep 08 16:21:48.903537 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 364/754] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:48 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:48.972196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:48.973281 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:48.999570 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.003295 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:49.004788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.005556 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:49.345827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-341d4954-f811-4674-bcbe-d0dd8aa154fe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:49.348104 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-341d4954-f811-4674-bcbe-d0dd8aa154fe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:49.371377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-341d4954-f811-4674-bcbe-d0dd8aa154fe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.372446 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-341d4954-f811-4674-bcbe-d0dd8aa154fe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:49.373604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-341d4954-f811-4674-bcbe-d0dd8aa154fe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.374744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-341d4954-f811-4674-bcbe-d0dd8aa154fe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:49.394945 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:49.427860 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d8b69f5e-0883-4228-9312-1b13c453e567 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.462286 Sep 08 16:21:49.428791 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 391/755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:48 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:49.537025 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-341d4954-f811-4674-bcbe-d0dd8aa154fe tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 23804 microversion: 2.1 time: 0.195611 Sep 08 16:21:49.541804 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 365/756] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:49 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 23804 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:49.618976 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c9369e84-0311-4f76-95cf-5a597b61b6d0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Action: 'create', calling method: .version_select at 0x7f3704406940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-915259818"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:49.646313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-c9369e84-0311-4f76-95cf-5a597b61b6d0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Getting quotas for project 73141861083d409898791956fbfb9619. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:21:49.651279 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-c9369e84-0311-4f76-95cf-5a597b61b6d0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Getting quotas for user 10dada2bb3054a58ae5b38d4579475c2 and project 73141861083d409898791956fbfb9619. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:21:49.809664 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-c9369e84-0311-4f76-95cf-5a597b61b6d0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Getting quotas for project 73141861083d409898791956fbfb9619. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:21:49.815028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-c9369e84-0311-4f76-95cf-5a597b61b6d0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Getting quotas for user 10dada2bb3054a58ae5b38d4579475c2 and project 73141861083d409898791956fbfb9619. Resources: {'key_pairs'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:21:49.831960 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c9369e84-0311-4f76-95cf-5a597b61b6d0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.216896 Sep 08 16:21:49.832858 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 392/757] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Sep 8 16:21:49 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:49.834842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:49.835681 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:49.847249 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.847938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:49.849182 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.849787 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:49.919856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:49.921715 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:49.935074 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:21:49.935529 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.936339 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:49.938119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:49.938747 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:50.082359 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-377da452-0413-4071-9a5c-87dc7316f5c8 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 204 len: 0 microversion: 2.1 time: 0.253702 Sep 08 16:21:50.083050 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 366/758] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:21:49 2021] DELETE /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 16:21:50.092404 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-166845012", "imageRef": "e9bbb7fb-259d-4f61-b30c-25527c1046cb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-915259818", "networks": [{"uuid": "e8e36103-d4a7-4534-8a1c-aa043a64be17"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:50.182786 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] validate_networks() for [('e8e36103-d4a7-4534-8a1c-aa043a64be17', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:21:50.187554 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:50.197852 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:50.199717 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:50.201062 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e8dbeb2a-1280-4962-a0fe-c5b2d7e7560e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.288969 Sep 08 16:21:50.201716 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 393/759] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:49 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:21:50.213472 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:50.214279 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:50.224711 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:50.225219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:50.226008 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:50.226434 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:50.646686 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:50.656120 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-109ae237-3b4a-48e1-9885-bf8d85dd1c4b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1503 microversion: 2.1 time: 0.447249 Sep 08 16:21:50.656721 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 394/760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:50 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:50.661808 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:50.662433 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:50.670795 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:50.671248 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:50.672087 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:50.672525 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.098499 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:51.107218 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3fb108a5-6691-4b4c-9a5a-9cb42956dfa3 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.449440 Sep 08 16:21:51.107961 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 395/761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:50 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:51.113527 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-36246a64-3149-4b90-9d01-bdf930329c36 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:51.114579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-36246a64-3149-4b90-9d01-bdf930329c36 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:51.122366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-36246a64-3149-4b90-9d01-bdf930329c36 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.122816 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-36246a64-3149-4b90-9d01-bdf930329c36 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.123638 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-36246a64-3149-4b90-9d01-bdf930329c36 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.124074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-36246a64-3149-4b90-9d01-bdf930329c36 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.144946 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:21:51.145691 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:21:51.146541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:21:51.147561 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:21:51.148269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:21:51.164649 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.165402 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.166781 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.167744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.201933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Getting quotas for project 73141861083d409898791956fbfb9619. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:21:51.209847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Getting quotas for user 10dada2bb3054a58ae5b38d4579475c2 and project 73141861083d409898791956fbfb9619. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:21:51.231721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:21:51.236551 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9bbb7fb-259d-4f61-b30c-25527c1046cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:21:51.271524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-36246a64-3149-4b90-9d01-bdf930329c36 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 26045 microversion: 2.1 time: 0.161649 Sep 08 16:21:51.278632 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 396/762] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:51 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 26045 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:51.286867 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:51.292145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:51.301856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.302701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.303998 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.304540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.308960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-64027149-09d4-4b83-8821-5a1cd06edbf0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221021 Sep 08 16:21:51.309962 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 367/763] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:21:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:21:51.325012 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-29c331da-9522-41d9-a86d-6257b11733d3 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:51.326206 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-29c331da-9522-41d9-a86d-6257b11733d3 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:51.409643 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-29c331da-9522-41d9-a86d-6257b11733d3 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:51.420069 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-29c331da-9522-41d9-a86d-6257b11733d3 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1257 microversion: 2.1 time: 0.100958 Sep 08 16:21:51.420834 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 368/764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:51 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1257 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:51.656070 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:51.667880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:51.672641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:51.674541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-978e5890-55b9-437d-8a4f-82082cbb6c04 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.399531 Sep 08 16:21:51.675353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 397/765] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:51 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:51.681632 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:51.682615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:51.693269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.693823 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:51.694692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:51.695206 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:52.131974 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:52.133621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:52.150439 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:52.151615 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:52.153526 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:52.154544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:52.596453 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:52.607255 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-dd4b39bc-8845-4f8a-90d0-03593a0e5599 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1503 microversion: 2.1 time: 0.935205 Sep 08 16:21:52.607922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 369/766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:51 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1503 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:52.626409 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-dc9d918a-9462-40c5-82c9-cbc6cdfdb268 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:52.627555 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-dc9d918a-9462-40c5-82c9-cbc6cdfdb268 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:52.636863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc9d918a-9462-40c5-82c9-cbc6cdfdb268 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:52.637545 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc9d918a-9462-40c5-82c9-cbc6cdfdb268 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:52.638170 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc9d918a-9462-40c5-82c9-cbc6cdfdb268 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:52.638698 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dc9d918a-9462-40c5-82c9-cbc6cdfdb268 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:52.781058 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-dc9d918a-9462-40c5-82c9-cbc6cdfdb268 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 27285 microversion: 2.1 time: 0.158584 Sep 08 16:21:52.787199 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 370/767] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:52 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 27285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:52.797725 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:52.801477 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:52.813118 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:52.813938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:52.816240 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:52.817255 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:53.051283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:53.071780 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-28b8a87f-f1b3-4373-a112-f84d281e4e65 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.947388 Sep 08 16:21:53.073230 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 398/768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:52 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:53.094196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:53.094778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:53.097967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:53.109524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:53.110365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:53.113299 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:53.114416 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:53.120281 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fa204ccf-46be-4544-8cc6-6ea350b1e682 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1317 microversion: 2.1 time: 0.330069 Sep 08 16:21:53.121349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 371/769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:52 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:53.659462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-f0ec92b1-d258-406a-be02-0ee3420001d6 req-37c5d678-7c09-4f1c-b6c9-17b01e97321a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba6c642-aaa3-47c7-82a7-b2190f9266be", "name": "network-vif-deleted", "tag": "933933a1-91b4-4222-abf0-80b0f7c6437c"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:53.667458 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:53.667458 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:21:53.712564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f0ec92b1-d258-406a-be02-0ee3420001d6 req-37c5d678-7c09-4f1c-b6c9-17b01e97321a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:53.713686 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f0ec92b1-d258-406a-be02-0ee3420001d6 req-37c5d678-7c09-4f1c-b6c9-17b01e97321a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:53.797073 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-f0ec92b1-d258-406a-be02-0ee3420001d6 req-37c5d678-7c09-4f1c-b6c9-17b01e97321a service nova] Creating event network-vif-deleted:933933a1-91b4-4222-abf0-80b0f7c6437c for instance cba6c642-aaa3-47c7-82a7-b2190f9266be on hv-cinder-80789 Sep 08 16:21:53.817865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-f0ec92b1-d258-406a-be02-0ee3420001d6 req-37c5d678-7c09-4f1c-b6c9-17b01e97321a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266336 Sep 08 16:21:53.821228 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 372/770] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:21:53.846664 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:53.848444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:53.869641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:53.890313 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:53.894044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:53.895941 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:53.901571 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:53.903196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:53.919522 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:53.922450 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f037ec55-dc22-45e5-9798-577b41b687fd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.847597 Sep 08 16:21:53.941249 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 399/771] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:53 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:53.959197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-0cf6b438-4083-4a4c-9042-ed6f499f8b52 req-3ba65031-0086-4867-8df3-13ae6a78a6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3b840e-551f-45cd-bbb8-079394ec0f1a", "name": "network-vif-plugged", "status": "completed", "tag": "6d93681d-822b-4cdf-8b2f-08faccca27db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:53.964326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:21:53.964326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:21:53.992434 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-0cf6b438-4083-4a4c-9042-ed6f499f8b52 req-3ba65031-0086-4867-8df3-13ae6a78a6f5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:53.993626 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-0cf6b438-4083-4a4c-9042-ed6f499f8b52 req-3ba65031-0086-4867-8df3-13ae6a78a6f5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:54.072581 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-0cf6b438-4083-4a4c-9042-ed6f499f8b52 req-3ba65031-0086-4867-8df3-13ae6a78a6f5 service nova] Creating event network-vif-plugged:6d93681d-822b-4cdf-8b2f-08faccca27db for instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a on hv-cinder-80789 Sep 08 16:21:54.092495 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-0cf6b438-4083-4a4c-9042-ed6f499f8b52 req-3ba65031-0086-4867-8df3-13ae6a78a6f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146546 Sep 08 16:21:54.097998 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 400/772] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:21:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:21:54.113635 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e52d9348-a55b-47d6-aecd-08489248857b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:54.115151 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e52d9348-a55b-47d6-aecd-08489248857b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:54.120062 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:54.120734 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:54.123341 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:21:54.135389 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e52d9348-a55b-47d6-aecd-08489248857b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:54.136167 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e52d9348-a55b-47d6-aecd-08489248857b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:54.137155 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e52d9348-a55b-47d6-aecd-08489248857b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:54.137794 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e52d9348-a55b-47d6-aecd-08489248857b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:54.351054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:54.363531 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7da67301-15f9-488d-a873-a7cb385ce9e4 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.540358 Sep 08 16:21:54.379558 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 373/773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:53 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:54.400150 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:54.406362 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:54.422291 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:54.422752 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:54.425451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:54.425905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:54.599580 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e52d9348-a55b-47d6-aecd-08489248857b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 28061 microversion: 2.1 time: 0.498891 Sep 08 16:21:54.605853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 401/774] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:54 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 28061 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:21:54.615277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:54.617606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:54.629968 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:54.630773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:54.633733 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:54.634796 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:55.123877 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:55.134557 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3c064ede-ede4-441b-872b-e87c7a9e6ec7 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.768929 Sep 08 16:21:55.145607 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 374/775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:54 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:55.152917 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:55.159835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:55.160453 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:55.163216 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3e325a5b-a9aa-4cb1-9bb6-37db3a562575 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.555694 Sep 08 16:21:55.164245 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 402/776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:54 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:55.168576 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:55.169026 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:55.169823 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:55.170267 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:55.394727 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:55.395358 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:55.405201 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:55.405536 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:55.406951 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:55.408282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:55.439211 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:55.449268 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:55.450853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:55.452072 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8e1016fd-a2a7-4a25-a448-e256a7a0d37a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.305231 Sep 08 16:21:55.452654 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 375/777] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:55 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:55.489689 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:55.490236 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:55.490649 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:21:55.560829 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:55.577318 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d23f7028-ecf8-49ca-b0bc-2277c2641184 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.186099 Sep 08 16:21:55.578528 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 403/778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:55 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:55.618503 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a81bd34e-1ab3-4b3c-8860-20c0659dc12f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:21:55.620170 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a81bd34e-1ab3-4b3c-8860-20c0659dc12f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:55.629699 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a81bd34e-1ab3-4b3c-8860-20c0659dc12f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:55.630200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a81bd34e-1ab3-4b3c-8860-20c0659dc12f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:55.631042 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a81bd34e-1ab3-4b3c-8860-20c0659dc12f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:55.631490 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a81bd34e-1ab3-4b3c-8860-20c0659dc12f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:56.151751 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:56.152409 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:56.161139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:56.161865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:56.162379 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:56.163032 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:56.433149 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:56.449553 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5b0b5689-aba1-4a0a-8ef2-d734934e6def tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.301200 Sep 08 16:21:56.451173 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 404/779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:56 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:56.459991 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:56.461266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:56.477074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:56.477864 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:56.479274 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:56.480142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:56.845799 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:56.860818 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b687d6f6-cace-4ae2-b3c3-f644fe476dfa tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.407532 Sep 08 16:21:56.872778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 405/780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:56 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:56.872778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:56.872778 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:56.883668 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:56.884990 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:56.895510 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:56.895510 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:57.195039 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:57.210800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:57.212387 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:57.213563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5d682303-46a4-4f97-a7f6-f6ec1bc91031 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.350206 Sep 08 16:21:57.214119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 406/781] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:56 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:57.218851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:57.219772 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:57.229175 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:57.229622 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:57.230424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:57.230856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:57.309829 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:57.310266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:57.310722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:21:57.387913 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:57.403700 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ac868983-fa34-4f77-b008-8159367a3972 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.187968 Sep 08 16:21:57.404730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 407/782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:57 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:57.472621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:57.473950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:57.490388 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:57.491217 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:57.492642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:57.493390 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:57.819952 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:57.829245 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b1931f83-9757-4841-97dc-fc7343389a1f tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.365132 Sep 08 16:21:57.830420 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 408/783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:57 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:57.892148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:57.893023 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:57.907955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:57.908901 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:57.910465 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:57.911357 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:58.317762 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:58.335770 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6ce5d02d-f0f3-4b4c-af19-51b7b8754277 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.449391 Sep 08 16:21:58.337413 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 409/784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:57 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:58.355777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:58.356922 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:58.371957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:58.372761 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:58.374186 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:58.374996 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:58.696914 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:58.710362 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:58.712025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:58.713303 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-054e303f-bf4e-45df-b12e-599c4c3e62d3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.365028 Sep 08 16:21:58.713889 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 410/785] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:58 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:21:58.718748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:58.719496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:58.734310 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:58.734785 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:58.736150 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:58.736844 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:58.834609 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:58.835166 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:58.835650 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:21:58.951800 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:58.971262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-767fd6f4-498e-479c-95c1-a47c69bb42e9 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.254367 Sep 08 16:21:58.972350 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 411/786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:58 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:58.981888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:58.982951 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:58.998770 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:59.000037 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:59.002229 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:59.002910 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:59.291496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:59.310037 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9cbd8029-6d3c-4a45-b00d-e0e0d38f6ac2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.335806 Sep 08 16:21:59.311015 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 412/787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:58 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:21:59.362052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:59.363321 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:59.371980 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:59.372561 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:59.373483 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:59.374020 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:59.663379 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:21:59.678635 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e88e3184-bbdc-45da-be79-a7a3b09d96ef tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.321625 Sep 08 16:21:59.679538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 413/788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:21:59 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:21:59.748355 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:21:59.749541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:21:59.761651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:59.761651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:21:59.762557 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:21:59.763203 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:00.051955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:00.062846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:00.065290 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:00.066533 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dcbcd4d5-3412-41a2-b1f4-02e9ac8cfb45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.325510 Sep 08 16:22:00.067138 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 414/789] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:21:59 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:00.071884 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:00.072497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:00.084748 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:00.085222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:00.086258 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:00.086706 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:00.161629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:00.162144 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:00.162612 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:22:00.266091 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:00.281848 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-17e1fe00-4d65-49dc-b288-316e981ad9d1 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.213258 Sep 08 16:22:00.299524 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 415/790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:00 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:00.338508 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:00.339749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:00.354193 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:00.355009 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:00.356538 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:00.357400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:00.706701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:00.715646 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3a888c4a-22d2-4247-8cc4-a81490e17b29 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.383705 Sep 08 16:22:00.716232 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 416/791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:00 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:00.721290 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:00.721888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:00.729954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:00.730391 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:00.731207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:00.731678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:01.058402 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:01.067976 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7d58a2ce-7b05-46a2-9dca-114c61c2afb4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.350629 Sep 08 16:22:01.068722 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 417/792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:00 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:01.096355 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:01.096997 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:01.104799 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:01.105252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:01.106042 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:01.106574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:01.382966 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:01.400746 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:01.404805 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:01.406667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f1ce2d8d-bd44-43d7-a9d3-5f39f83d79bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.315303 Sep 08 16:22:01.420847 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 418/793] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:01 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:01.429261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:01.430687 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:01.440708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:01.441272 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:01.441971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:01.442399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:01.538019 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:01.538705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:01.539523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:22:01.629336 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:01.642811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7e42d9ed-bdef-4845-85ea-a1694d124f97 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.219558 Sep 08 16:22:01.653230 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 419/794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:01 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:01.741696 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:01.746700 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:01.766645 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:01.767481 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:01.768556 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:01.772192 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:02.041811 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:02.053036 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-420324ef-652b-4579-808c-b42ba3bc7a1d tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.319654 Sep 08 16:22:02.054114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 420/795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:01 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:02.085919 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:02.086627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:02.094615 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:02.095720 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:02.096579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:02.096967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:02.398262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:02.407132 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c5b3bf40-e45c-47df-8940-f02df2c9d9ae tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.324975 Sep 08 16:22:02.409018 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 421/796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:02 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:02.434745 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:02.435871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:02.450342 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:02.451609 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:02.453414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:02.454218 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:02.799620 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:02.817474 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:02.820615 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:02.822749 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5d046a10-41ba-4bad-abbe-1f47c14d852b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.394853 Sep 08 16:22:02.823792 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 422/797] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:02 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:02.836931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:02.838237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:02.855260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:02.856099 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:02.857571 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:02.858743 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:02.998979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:02.999723 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:03.001737 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:22:03.100205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:03.114539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-916e4fbe-a531-41fc-9413-b3be5a1c0d80 tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.288806 Sep 08 16:22:03.115386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 423/798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:02 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:03.124761 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:03.125890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:03.138563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:03.138563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:03.139195 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:03.139851 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:03.480809 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:03.497743 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-90c41952-1cb8-4d20-8560-cd51677e8312 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.380527 Sep 08 16:22:03.498820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 424/799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:03 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:03.508207 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:03.509315 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:03.523510 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:03.524292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:03.525674 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:03.526436 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:03.863912 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:03.874690 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b86d6f50-bc2a-4866-b992-ce06a6e3a9ac tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.374345 Sep 08 16:22:03.875684 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 425/800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:03 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:03.882463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:03.883593 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:03.892745 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:03.893592 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:03.894652 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:03.895393 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:04.175550 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:04.188136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:04.191115 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:04.192407 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5b5b8d4d-24ef-41e4-9b1a-cd5c02f474b9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.314687 Sep 08 16:22:04.199534 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 426/801] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:03 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:04.204148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:04.205134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:04.213986 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:04.214462 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:04.215435 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:04.215909 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:04.294962 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:04.295791 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:04.296374 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lazy-loading 'fault' on Instance uuid cba6c642-aaa3-47c7-82a7-b2190f9266be {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:22:04.358714 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3811fbb13d4488bd68feafdb8da149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ffbd0760e4ad69bef0e867ad6c4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:04.372594 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-043cdb04-a378-4bbe-94e0-38bb213e570b tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 200 len: 1303 microversion: 2.1 time: 0.172212 Sep 08 16:22:04.373471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 427/802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:04 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 1303 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:04.519515 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:04.520123 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:04.528113 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:04.528560 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:04.529347 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:04.529774 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:04.788464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:04.801613 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-992709b8-5553-412c-a74d-a52d94d856e0 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.286541 Sep 08 16:22:04.803027 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 428/803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:04 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:04.912453 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a81bd34e-1ab3-4b3c-8860-20c0659dc12f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 28645 microversion: 2.1 time: 9.297284 Sep 08 16:22:04.913411 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:04.914322 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 376/804] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:21:55 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 28645 bytes in 9300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:04.917449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:04.938833 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:04.939864 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:04.941532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:04.946756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.212991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:05.212991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:05.226066 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.227236 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.229000 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.229994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.569756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:05.590759 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-673a8373-62f3-4be5-8041-bd992c3d1722 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.686978 Sep 08 16:22:05.594427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 429/805] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:04 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:05.604823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:05.606066 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] [instance: cba6c642-aaa3-47c7-82a7-b2190f9266be] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:05.637195 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.637742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.638721 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.639198 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.701601 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] HTTP exception thrown: Instance cba6c642-aaa3-47c7-82a7-b2190f9266be could not be found. Sep 08 16:22:05.702435 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] Returning 404 to user: Instance cba6c642-aaa3-47c7-82a7-b2190f9266be could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:22:05.703319 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2b25e7cc-1859-4200-a4fc-dcef79419cca tempest-VolumesActionsTest-976248711 tempest-VolumesActionsTest-976248711-project] 10.222.0.25 "GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be" status: 404 len: 111 microversion: 2.1 time: 0.109055 Sep 08 16:22:05.712767 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 430/806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:05 2021] GET /compute/v2.1/servers/cba6c642-aaa3-47c7-82a7-b2190f9266be => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:22:05.729390 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:05.740229 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:05.741756 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:05.743067 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-5e93fe4d-6d85-4af8-9a4c-e4c36e45f3ea tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.536006 Sep 08 16:22:05.744271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 377/807] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:05 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:05.823425 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:05.824366 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:05.835673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.836411 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.837432 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.838093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.925951 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2ef43676-d95f-4164-8f0d-9586f3ef0a39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:05.927163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2ef43676-d95f-4164-8f0d-9586f3ef0a39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:05.944103 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2ef43676-d95f-4164-8f0d-9586f3ef0a39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.944553 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2ef43676-d95f-4164-8f0d-9586f3ef0a39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:05.945362 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2ef43676-d95f-4164-8f0d-9586f3ef0a39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:05.945801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2ef43676-d95f-4164-8f0d-9586f3ef0a39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:06.163256 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2ef43676-d95f-4164-8f0d-9586f3ef0a39 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 28645 microversion: 2.1 time: 0.240946 Sep 08 16:22:06.163952 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 378/808] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:05 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 28645 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:22:06.238572 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:06.266051 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ecdfee21-8074-4b9a-abf6-ebc85ede7327 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1575 microversion: 2.1 time: 0.447849 Sep 08 16:22:06.271272 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 431/809] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:05 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1575 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:06.581578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-c9f64afd-d96c-4f20-b25a-28aa0465e481 req-99bb5b34-5794-450b-b8a0-8a579253054f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bdbfb7-ffb6-4948-947a-c946528dd2f4", "tag": "f2af78ec-25e1-4833-a7df-32634ee73ed6"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:06.586193 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:22:06.586193 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:22:06.611372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-c9f64afd-d96c-4f20-b25a-28aa0465e481 req-99bb5b34-5794-450b-b8a0-8a579253054f service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:06.612692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-c9f64afd-d96c-4f20-b25a-28aa0465e481 req-99bb5b34-5794-450b-b8a0-8a579253054f service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:06.621261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:06.623130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:06.648150 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-c9f64afd-d96c-4f20-b25a-28aa0465e481 req-99bb5b34-5794-450b-b8a0-8a579253054f service nova] Creating event network-changed:f2af78ec-25e1-4833-a7df-32634ee73ed6 for instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 on hv-cinder-80789 Sep 08 16:22:06.656741 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-c9f64afd-d96c-4f20-b25a-28aa0465e481 req-99bb5b34-5794-450b-b8a0-8a579253054f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087163 Sep 08 16:22:06.661016 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 379/810] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:22:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:06.665346 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:06.665805 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:06.666618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:06.667078 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:06.780774 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:06.784483 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:06.821698 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:06.822839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:06.840759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:06.841826 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:07.410069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:07.441822 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-12432bef-5019-4e3a-9f05-386b6e5446f4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.825814 Sep 08 16:22:07.442966 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 432/811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:06 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:07.464813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-75776bab-8a83-4e52-8d84-b38dbd3e4b16 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:07.470855 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-75776bab-8a83-4e52-8d84-b38dbd3e4b16 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:07.488691 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:07.495071 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75776bab-8a83-4e52-8d84-b38dbd3e4b16 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:07.499158 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75776bab-8a83-4e52-8d84-b38dbd3e4b16 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:07.503276 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75776bab-8a83-4e52-8d84-b38dbd3e4b16 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:07.504148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75776bab-8a83-4e52-8d84-b38dbd3e4b16 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:07.504455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:07.506940 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:07.509439 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3ddc77f0-4438-410e-a75b-91149d73d33c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1745 microversion: 2.20 time: 0.738335 Sep 08 16:22:07.510629 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 380/812] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:06 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1745 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:07.516798 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:07.518445 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:07.528867 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:07.530860 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:07.533370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:07.534123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:07.713215 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-75776bab-8a83-4e52-8d84-b38dbd3e4b16 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 29649 microversion: 2.1 time: 0.267720 Sep 08 16:22:07.718995 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 433/813] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:07 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 29649 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:07.958328 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:07.974976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-27c4dcc7-f329-48cb-9c7e-db107309a99a tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1562 microversion: 2.1 time: 0.462460 Sep 08 16:22:07.976392 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 381/814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:07 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1562 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:08.473783 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:08.474903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:08.489589 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:08.490392 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:08.491773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:08.492572 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:08.546856 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:08.549438 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:08.563076 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:08.564307 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:08.565918 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:08.566914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:08.837804 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:08.847869 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-563e4995-df73-4a8a-b372-e2c44ded2055 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.380533 Sep 08 16:22:08.848219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 434/815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:08 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:08.853106 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ced6c7b1-3cb2-48e7-957a-9a1410e422e1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:08.854095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ced6c7b1-3cb2-48e7-957a-9a1410e422e1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:08.863394 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ced6c7b1-3cb2-48e7-957a-9a1410e422e1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:08.864306 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ced6c7b1-3cb2-48e7-957a-9a1410e422e1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:08.866198 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ced6c7b1-3cb2-48e7-957a-9a1410e422e1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:08.866952 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ced6c7b1-3cb2-48e7-957a-9a1410e422e1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:08.916704 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:08.928815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:08.931697 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:08.933437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ff81f104-3be3-407c-97c0-2d45d2e9f1b7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.393557 Sep 08 16:22:08.934174 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 382/816] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:08 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:09.874484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:09.875862 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:09.886129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:09.886750 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:09.887767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:09.888310 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:10.118023 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:10.134432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-dbbe6e1f-50f6-4657-a8f0-b16dc44f439b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.263509 Sep 08 16:22:10.135596 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 383/817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:09 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:10.144418 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:10.145468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:10.160102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:10.160887 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:10.162271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:10.163040 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:10.442547 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:10.460634 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:10.464133 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:10.466594 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fa272cc4-02c3-4d4e-a1c7-a6fdc799bfb5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.329183 Sep 08 16:22:10.467795 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 384/818] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:10 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:10.672769 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-09f48599-353b-4cdd-af3a-badc8835236a req-cef64203-4574-4ae4-937d-177dc7ddd49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5fbdd8-f58c-4d16-be45-d9003f0e770c", "name": "network-vif-plugged", "status": "completed", "tag": "0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:10.675430 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:22:10.675430 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:22:10.686584 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-09f48599-353b-4cdd-af3a-badc8835236a req-cef64203-4574-4ae4-937d-177dc7ddd49c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:10.687336 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-09f48599-353b-4cdd-af3a-badc8835236a req-cef64203-4574-4ae4-937d-177dc7ddd49c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:10.708852 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-09f48599-353b-4cdd-af3a-badc8835236a req-cef64203-4574-4ae4-937d-177dc7ddd49c service nova] Creating event network-vif-plugged:0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54 for instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c on hv-cinder-80789 Sep 08 16:22:10.714818 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-09f48599-353b-4cdd-af3a-badc8835236a req-cef64203-4574-4ae4-937d-177dc7ddd49c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046996 Sep 08 16:22:10.715786 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 385/819] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:22:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:11.154869 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:11.155641 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:11.164593 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:11.165035 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:11.165839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:11.166286 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:11.397020 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:11.413566 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0d6b7045-a24d-4087-a501-d523999ab689 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.262463 Sep 08 16:22:11.414825 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 386/820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:11 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:11.430325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ced6c7b1-3cb2-48e7-957a-9a1410e422e1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 34460 microversion: 2.1 time: 2.579469 Sep 08 16:22:11.431155 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 435/821] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:08 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 34460 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:11.496452 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:11.497799 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:11.507449 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:11.507936 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:11.508748 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:11.509183 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:11.854980 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:11.896953 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:11.902982 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:11.907262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b02eb9ec-82d2-41b2-a9c8-46cbdb514a45 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.415651 Sep 08 16:22:11.916623 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 387/822] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:11 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:12.436542 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:12.437715 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:12.448373 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ef5a6f3a-3cef-4354-b259-e73c65d6ee2f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:12.454104 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ef5a6f3a-3cef-4354-b259-e73c65d6ee2f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:12.479281 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:12.480012 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:12.481197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:12.481818 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:12.487979 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef5a6f3a-3cef-4354-b259-e73c65d6ee2f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:12.491006 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef5a6f3a-3cef-4354-b259-e73c65d6ee2f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:12.497869 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef5a6f3a-3cef-4354-b259-e73c65d6ee2f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:12.508661 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef5a6f3a-3cef-4354-b259-e73c65d6ee2f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:12.685537 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ef5a6f3a-3cef-4354-b259-e73c65d6ee2f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 35373 microversion: 2.1 time: 0.243618 Sep 08 16:22:12.686747 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 388/823] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:12 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 35373 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:22:12.936909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:12.937690 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:12.963295 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:12.963783 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:12.964605 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:12.965050 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:13.027499 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:13.060060 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-de87ac34-c9f7-4c2c-b3c3-91c99546340a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.629748 Sep 08 16:22:13.061373 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 436/824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:12 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:13.449604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:13.479528 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:13.479528 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:13.481335 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1963976d-53ee-4669-aef1-51521bf966ec tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.548963 Sep 08 16:22:13.482338 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 389/825] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:12 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:13.703266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ecd0f9d7-80c3-4192-b172-64c518b01927 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:13.704326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ecd0f9d7-80c3-4192-b172-64c518b01927 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:13.713313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecd0f9d7-80c3-4192-b172-64c518b01927 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:13.714177 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecd0f9d7-80c3-4192-b172-64c518b01927 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:13.715231 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecd0f9d7-80c3-4192-b172-64c518b01927 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:13.715923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecd0f9d7-80c3-4192-b172-64c518b01927 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:13.934579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ecd0f9d7-80c3-4192-b172-64c518b01927 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 36472 microversion: 2.1 time: 0.234491 Sep 08 16:22:13.940000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 437/826] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:13 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 36472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:22:14.093900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:14.094779 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:14.124293 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:14.124917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:14.128124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:14.128892 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:14.512268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:14.513937 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:14.523872 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:14.524378 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:14.525315 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:14.525822 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:14.811766 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:14.836452 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-93f09caf-f7a4-435f-9809-b619ba6a2f0c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.746277 Sep 08 16:22:14.838832 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 390/827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:14 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:14.952260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a277d19e-88e7-4bee-814b-628ebb66a414 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:14.953401 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a277d19e-88e7-4bee-814b-628ebb66a414 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:14.980270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a277d19e-88e7-4bee-814b-628ebb66a414 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:14.981072 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a277d19e-88e7-4bee-814b-628ebb66a414 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:14.982524 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a277d19e-88e7-4bee-814b-628ebb66a414 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:14.983321 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a277d19e-88e7-4bee-814b-628ebb66a414 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:15.085353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:15.100332 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:15.114326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:15.115558 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b9cea69c-0c60-49f2-abd3-915e07d9a96b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.609390 Sep 08 16:22:15.133226 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 438/828] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:14 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:15.311257 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a277d19e-88e7-4bee-814b-628ebb66a414 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 37974 microversion: 2.1 time: 0.362248 Sep 08 16:22:15.316179 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 391/829] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:14 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 37974 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:15.855963 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:15.856603 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:15.866757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:15.867231 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:15.868325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:15.868754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:16.142306 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:16.143923 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:16.166327 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:16.172004 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:16.173852 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:16.174534 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:16.324076 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:16.342518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-02ac3b1d-96b9-4b44-afcf-9ce9ba4c8052 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.487663 Sep 08 16:22:16.343569 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 439/830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:15 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:16.357772 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b936d726-9ad0-4665-9de3-61a0a62fce2a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:16.359311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b936d726-9ad0-4665-9de3-61a0a62fce2a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:16.416185 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b936d726-9ad0-4665-9de3-61a0a62fce2a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:16.419194 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b936d726-9ad0-4665-9de3-61a0a62fce2a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:16.425297 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b936d726-9ad0-4665-9de3-61a0a62fce2a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:16.428220 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b936d726-9ad0-4665-9de3-61a0a62fce2a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:16.713339 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b936d726-9ad0-4665-9de3-61a0a62fce2a tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 38171 microversion: 2.1 time: 0.367812 Sep 08 16:22:16.715967 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 440/831] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:16 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 38171 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:16.870615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:16.896452 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:16.905697 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:16.910097 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-67cfd611-64c6-4bae-b3d6-eee667198ed1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.769965 Sep 08 16:22:16.911165 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 392/832] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:16 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:17.380842 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:17.382385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:17.400272 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:17.400808 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:17.401570 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:17.409161 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:17.745940 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-895e7b51-521e-488b-97a9-f86c0165f092 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:17.757586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-895e7b51-521e-488b-97a9-f86c0165f092 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:17.796122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-895e7b51-521e-488b-97a9-f86c0165f092 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:17.798630 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-895e7b51-521e-488b-97a9-f86c0165f092 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:17.801349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-895e7b51-521e-488b-97a9-f86c0165f092 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:17.802528 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-895e7b51-521e-488b-97a9-f86c0165f092 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:18.039757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:18.047590 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-895e7b51-521e-488b-97a9-f86c0165f092 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 38171 microversion: 2.1 time: 0.322804 Sep 08 16:22:18.056805 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 393/833] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:17 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 38171 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:18.068918 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:18.071813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-242ed835-8d63-4dc6-a72e-0e24e53b3286 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.688397 Sep 08 16:22:18.085999 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 441/834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:17 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:18.086669 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:18.098177 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:18.098939 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:18.099802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:18.100243 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:18.580019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:18.599919 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:18.604474 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:18.608163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ba40a843-e98d-4918-99e7-d3cae35f88cf tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.553013 Sep 08 16:22:18.618021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 394/835] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:18 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:19.076823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fc5b8d5b-3bb6-4653-b46f-9f7f7d1470f6 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:19.082936 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fc5b8d5b-3bb6-4653-b46f-9f7f7d1470f6 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:19.107150 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:19.109247 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:19.135137 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d5b-3bb6-4653-b46f-9f7f7d1470f6 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:19.142352 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:19.143260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d5b-3bb6-4653-b46f-9f7f7d1470f6 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:19.144176 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:19.144532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d5b-3bb6-4653-b46f-9f7f7d1470f6 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:19.145399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fc5b8d5b-3bb6-4653-b46f-9f7f7d1470f6 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:19.146362 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:19.147392 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:19.547431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fc5b8d5b-3bb6-4653-b46f-9f7f7d1470f6 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 38185 microversion: 2.1 time: 0.485399 Sep 08 16:22:19.553237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 442/836] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:19 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 38185 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:19.639227 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:19.639963 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:19.654079 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:19.654560 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:19.655338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:19.655798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:19.785496 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:19.832369 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-aa427e9c-3068-4cc1-8df2-5c7a54b2fa49 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.730680 Sep 08 16:22:19.854250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 395/837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:19 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:20.127642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:20.144827 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:20.146357 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:20.149085 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3d3751ac-df7d-4d4e-a8b0-7c37367e92b3 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.514013 Sep 08 16:22:20.165812 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 443/838] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:19 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:20.178380 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-d1dab40a-a69b-4f30-850e-bb84d92aa26a req-f62cbaad-c5ae-4e35-9659-a5226572bf95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bdbfb7-ffb6-4948-947a-c946528dd2f4", "name": "network-vif-plugged", "status": "completed", "tag": "f2af78ec-25e1-4833-a7df-32634ee73ed6"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:20.180564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:22:20.180564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:22:20.209437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-d1dab40a-a69b-4f30-850e-bb84d92aa26a req-f62cbaad-c5ae-4e35-9659-a5226572bf95 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:20.209979 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-d1dab40a-a69b-4f30-850e-bb84d92aa26a req-f62cbaad-c5ae-4e35-9659-a5226572bf95 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:20.265206 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-d1dab40a-a69b-4f30-850e-bb84d92aa26a req-f62cbaad-c5ae-4e35-9659-a5226572bf95 service nova] Creating event network-vif-plugged:f2af78ec-25e1-4833-a7df-32634ee73ed6 for instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 on hv-cinder-80789 Sep 08 16:22:20.278518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-d1dab40a-a69b-4f30-850e-bb84d92aa26a req-f62cbaad-c5ae-4e35-9659-a5226572bf95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110978 Sep 08 16:22:20.282957 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 396/839] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:22:20.561102 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c7140507-4d6b-4a71-9ebb-afa7b03d0296 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:20.562782 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c7140507-4d6b-4a71-9ebb-afa7b03d0296 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:20.575037 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7140507-4d6b-4a71-9ebb-afa7b03d0296 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:20.576269 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7140507-4d6b-4a71-9ebb-afa7b03d0296 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:20.577423 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7140507-4d6b-4a71-9ebb-afa7b03d0296 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:20.578166 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7140507-4d6b-4a71-9ebb-afa7b03d0296 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:20.870058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c7140507-4d6b-4a71-9ebb-afa7b03d0296 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action" status: 200 len: 38302 microversion: 2.1 time: 0.312573 Sep 08 16:22:20.876590 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 444/840] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:20 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/action => generated 38302 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:22:20.881444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:20.890337 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:20.909723 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9dc7415b-298e-426e-bab6-0d3bc4a1df86 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:20.920817 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9dc7415b-298e-426e-bab6-0d3bc4a1df86 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:20.948246 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:20.949726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:20.951521 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:20.961758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:20.984491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9dc7415b-298e-426e-bab6-0d3bc4a1df86 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:20.986479 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9dc7415b-298e-426e-bab6-0d3bc4a1df86 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:20.989260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9dc7415b-298e-426e-bab6-0d3bc4a1df86 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:20.990412 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9dc7415b-298e-426e-bab6-0d3bc4a1df86 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:21.306049 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9dc7415b-298e-426e-bab6-0d3bc4a1df86 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/ips" status: 200 len: 144 microversion: 2.1 time: 0.418363 Sep 08 16:22:21.307601 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 445/841] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Sep 8 16:22:20 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/ips => generated 144 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:21.321335 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:21.322350 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:21.338685 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:21.339520 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:21.340981 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:21.341754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:21.631671 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:21.663407 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8edc100b-582a-4a83-94d7-4b964097a90e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.806118 Sep 08 16:22:21.667603 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 397/842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:20 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:21.887971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:21.917051 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:21.944486 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:21.946619 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7caf1eb3-bef2-4185-881f-5bc3dafa162a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.633992 Sep 08 16:22:21.947609 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 446/843] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:21 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:22.693968 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:22.696055 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:22.719860 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:22.721212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:22.722258 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:22.722907 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:22.981240 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:22.982270 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:23.020093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:23.020854 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:23.022263 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:23.023128 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:23.528894 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:23.549041 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a879c681-941a-4c5e-ae83-eb854869c3c5 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1357 microversion: 2.1 time: 0.859865 Sep 08 16:22:23.570923 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 398/844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:22 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1357 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:23.616573 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:23.635319 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:23.639007 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:23.641385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f32915c6-d495-42eb-8f60-12c0f0635f65 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.666940 Sep 08 16:22:23.663601 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 447/845] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:22 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:23.722084 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-efd51ae4-6439-474a-ada5-1269b4dd7ec0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f0dc9f1-100e-45c1-9bf2-01a2e46c64e7"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:23.724895 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-efd51ae4-6439-474a-ada5-1269b4dd7ec0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:23.749652 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efd51ae4-6439-474a-ada5-1269b4dd7ec0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:23.750611 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efd51ae4-6439-474a-ada5-1269b4dd7ec0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:23.753535 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efd51ae4-6439-474a-ada5-1269b4dd7ec0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:23.754283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-efd51ae4-6439-474a-ada5-1269b4dd7ec0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:24.591946 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:24.594434 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:24.636089 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:24.638462 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:24.641525 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:24.648996 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:24.824146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-efd51ae4-6439-474a-ada5-1269b4dd7ec0 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.092964 Sep 08 16:22:24.827795 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 399/846] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:22:23 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments => generated 194 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:24.849125 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:24.853313 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:24.921558 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:24.925101 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:24.939808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:24.941144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:25.814326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:25.838765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e6600475-6c68-4fd4-8994-1afc1123431d tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1547 microversion: 2.1 time: 1.264067 Sep 08 16:22:25.852166 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 448/847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:24 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1547 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:25.864305 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:25.874673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:25.897740 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:25.898637 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:25.899745 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:25.900444 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:25.981800 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:26.003783 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:26.005706 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:26.008717 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d76d8db1-74e8-4172-b519-df10d72e2a9e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 1.177275 Sep 08 16:22:26.014323 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 400/848] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:24 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:26.419226 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:26.452877 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5445485d-5bb7-4f9a-83b1-57e1f5909c9b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1547 microversion: 2.1 time: 0.592660 Sep 08 16:22:26.478500 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:26.484234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 449/849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:25 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1547 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:26.490102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:22:26.490102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:22:26.492703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:26.494739 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Searching by: {'deleted': False, 'project_id': '73141861083d409898791956fbfb9619'} {{(pid=93617) get_all /opt/stack/nova/nova/compute/api.py:2855}} Sep 08 16:22:26.506269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:26.508203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:26.510570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:26.511249 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:26.758184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.multi_cell_list [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=93617) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 08 16:22:26.943742 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cf05d876-3251-497a-9bab-e641814bb0e1 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.471347 Sep 08 16:22:26.945682 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 401/850] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Sep 8 16:22:26 2021] GET /compute/v2.1/servers => generated 342 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:26.957751 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:26.959016 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:26.978451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:26.980142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:26.982171 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:26.984364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:27.052020 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:27.054455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:27.098945 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:27.100275 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:27.101896 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:27.103019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:27.474490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:27.570053 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-41fdf77c-a65d-401a-9239-aa05fdfd6802 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1547 microversion: 2.1 time: 0.616252 Sep 08 16:22:27.572222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 450/851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:26 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1547 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:27.712710 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:27.752340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:27.755905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:27.758659 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-583a6b88-63ef-4f18-af32-6ef1c8214ae6 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1740 microversion: 2.20 time: 0.715699 Sep 08 16:22:27.760088 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 402/852] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:27 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1740 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:28.797713 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:28.800642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:28.817249 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:28.818004 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:28.820753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:28.820753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:29.334898 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:29.353781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:29.355813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:29.358088 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-22975d5e-ab4f-4897-84f5-61c130b03edb tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1722 microversion: 2.20 time: 0.566019 Sep 08 16:22:29.371642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 451/853] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:28 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1722 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:30.341864 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c6acc4e8-2e97-4901-bd08-fa54bf8a05c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97f37573-a0b6-4a3b-807a-0593d1675c52"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:30.344286 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c6acc4e8-2e97-4901-bd08-fa54bf8a05c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:30.355875 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c6acc4e8-2e97-4901-bd08-fa54bf8a05c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:30.357588 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c6acc4e8-2e97-4901-bd08-fa54bf8a05c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:30.358978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c6acc4e8-2e97-4901-bd08-fa54bf8a05c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:30.359831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c6acc4e8-2e97-4901-bd08-fa54bf8a05c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:30.387103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:30.387835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:30.399304 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:30.399798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:30.400636 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:30.401082 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:30.937359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:30.948399 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:30.949882 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:30.951156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-21ed28e8-c444-486c-9c53-81b37ed1f336 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1722 microversion: 2.20 time: 0.568145 Sep 08 16:22:30.952189 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 452/854] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:30 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1722 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:31.144973 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c6acc4e8-2e97-4901-bd08-fa54bf8a05c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807567 Sep 08 16:22:31.146081 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 403/855] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:22:30 2021] POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments => generated 194 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:22:31.984124 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:31.985861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:31.994429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:31.994975 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:31.996128 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:31.996766 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:32.268752 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:32.279804 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:32.281805 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:32.283606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0f45413e-17db-409f-a29a-5f113b496ad8 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1722 microversion: 2.20 time: 0.303442 Sep 08 16:22:32.305586 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 453/856] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:31 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:33.306250 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:33.307377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:33.320336 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:33.320919 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:33.322200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:33.323006 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:33.741377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:33.754781 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:33.763461 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-f8dd2df4-5de4-465c-9a71-7dc11e05e77f req-09b09ffa-fdaa-44ab-8708-997c2559fcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5fbdd8-f58c-4d16-be45-d9003f0e770c", "name": "network-vif-unplugged", "status": "completed", "tag": "0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:33.766029 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:22:33.766029 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:22:33.780196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:33.785241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-63b02203-9a9d-4dbf-b57c-6d3be714761b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1725 microversion: 2.20 time: 0.485040 Sep 08 16:22:33.802874 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 404/857] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:33 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1725 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:33.817597 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a14c3456-7081-4001-ad4b-b0d192927792 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edaea06-4ab7-4378-bbf6-ad452f8f6b7f"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:33.818587 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-f8dd2df4-5de4-465c-9a71-7dc11e05e77f req-09b09ffa-fdaa-44ab-8708-997c2559fcc1 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:33.819332 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-f8dd2df4-5de4-465c-9a71-7dc11e05e77f req-09b09ffa-fdaa-44ab-8708-997c2559fcc1 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:33.822819 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a14c3456-7081-4001-ad4b-b0d192927792 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:33.843683 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a14c3456-7081-4001-ad4b-b0d192927792 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:33.845154 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a14c3456-7081-4001-ad4b-b0d192927792 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:33.846476 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a14c3456-7081-4001-ad4b-b0d192927792 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:33.847764 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a14c3456-7081-4001-ad4b-b0d192927792 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:33.869545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.compute.server_external_events [req-f8dd2df4-5de4-465c-9a71-7dc11e05e77f req-09b09ffa-fdaa-44ab-8708-997c2559fcc1 service nova] Unable to find a host for instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c. Dropping event network-vif-unplugged {{(pid=93618) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 08 16:22:33.873623 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-f8dd2df4-5de4-465c-9a71-7dc11e05e77f req-09b09ffa-fdaa-44ab-8708-997c2559fcc1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.115761 Sep 08 16:22:33.876181 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 454/858] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:22:33 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 119 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 08 16:22:34.060982 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b8fc718c-45cc-4c40-812b-a34951093370 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:34.064762 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b8fc718c-45cc-4c40-812b-a34951093370 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:34.082785 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8fc718c-45cc-4c40-812b-a34951093370 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:34.084208 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8fc718c-45cc-4c40-812b-a34951093370 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:34.085161 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8fc718c-45cc-4c40-812b-a34951093370 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:34.085725 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8fc718c-45cc-4c40-812b-a34951093370 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:34.194490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b8fc718c-45cc-4c40-812b-a34951093370 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137192 Sep 08 16:22:34.195082 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 455/859] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:22:34 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:34.212613 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c6a8702d-8686-43aa-b541-093c1c552cdc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:34.213397 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c6a8702d-8686-43aa-b541-093c1c552cdc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:34.222795 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c6a8702d-8686-43aa-b541-093c1c552cdc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:34.223563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c6a8702d-8686-43aa-b541-093c1c552cdc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:34.224533 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c6a8702d-8686-43aa-b541-093c1c552cdc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:34.225129 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c6a8702d-8686-43aa-b541-093c1c552cdc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:34.372991 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c6a8702d-8686-43aa-b541-093c1c552cdc tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/9f0dc9f1-100e-45c1-9bf2-01a2e46c64e7" status: 200 len: 194 microversion: 2.1 time: 0.163120 Sep 08 16:22:34.375574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 456/860] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Sep 8 16:22:34 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/9f0dc9f1-100e-45c1-9bf2-01a2e46c64e7 => generated 194 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:34.665487 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a14c3456-7081-4001-ad4b-b0d192927792 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.857140 Sep 08 16:22:34.667010 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 405/861] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Sep 8 16:22:33 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-volume_attachments => generated 188 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:22:35.262774 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-43915255-d38a-4507-b83c-99dc488203aa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:35.264635 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-43915255-d38a-4507-b83c-99dc488203aa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:35.284687 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43915255-d38a-4507-b83c-99dc488203aa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:35.285321 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43915255-d38a-4507-b83c-99dc488203aa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:35.287069 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43915255-d38a-4507-b83c-99dc488203aa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:35.287726 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-43915255-d38a-4507-b83c-99dc488203aa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:36.039136 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-43915255-d38a-4507-b83c-99dc488203aa tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-volume_attachments/9edaea06-4ab7-4378-bbf6-ad452f8f6b7f" status: 202 len: 0 microversion: 2.20 time: 0.781866 Sep 08 16:22:36.040682 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 457/862] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Sep 8 16:22:35 2021] DELETE /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-volume_attachments/9edaea06-4ab7-4378-bbf6-ad452f8f6b7f => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:22:36.255124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7726ecf3-0978-4186-9658-9366f31a34ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:36.257115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7726ecf3-0978-4186-9658-9366f31a34ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:36.273212 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7726ecf3-0978-4186-9658-9366f31a34ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:36.274824 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7726ecf3-0978-4186-9658-9366f31a34ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:36.276652 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7726ecf3-0978-4186-9658-9366f31a34ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:36.277726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7726ecf3-0978-4186-9658-9366f31a34ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:36.431795 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-966c9f60-8190-4810-95f2-6422841cafc8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "351ab47e-29b6-478a-90fa-b06d0cfb54ac"}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:36.437710 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-966c9f60-8190-4810-95f2-6422841cafc8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:36.462990 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966c9f60-8190-4810-95f2-6422841cafc8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:36.464245 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966c9f60-8190-4810-95f2-6422841cafc8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:36.465836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966c9f60-8190-4810-95f2-6422841cafc8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:36.466761 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-966c9f60-8190-4810-95f2-6422841cafc8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:36.617482 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7726ecf3-0978-4186-9658-9366f31a34ba tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action" status: 202 len: 0 microversion: 2.20 time: 0.369453 Sep 08 16:22:36.621921 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 406/863] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Sep 8 16:22:36 2021] POST /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:22:36.635285 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:36.636119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:36.650818 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:36.651756 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:36.653280 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:36.654114 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:37.151943 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:37.184837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:37.193948 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:37.196578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-107c500b-7a66-472b-a60f-50f55c9b527e tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1673 microversion: 2.20 time: 0.572319 Sep 08 16:22:37.199804 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 407/864] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:36 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1673 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:37.420629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-966c9f60-8190-4810-95f2-6422841cafc8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.996454 Sep 08 16:22:37.439799 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 458/865] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:22:36 2021] POST /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:38.229721 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:38.231045 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:38.259016 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:38.260157 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:38.261408 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:38.262091 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:38.662062 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:38.683021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:38.691222 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:38.693992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d85d54c0-dc13-4509-b0e0-d542ea04bb4c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1675 microversion: 2.20 time: 0.467777 Sep 08 16:22:38.695279 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 408/866] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:38 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1675 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:39.727309 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:39.728122 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:39.738424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:39.739078 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:39.739942 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:39.740392 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:40.101971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:40.120846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:40.122794 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:40.124114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fd85caaa-4cc2-446e-b8fd-6ba8f9280455 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.401834 Sep 08 16:22:40.135397 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 459/867] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:39 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:41.144954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:41.146277 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:41.169054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:41.169504 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:41.170302 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:41.170733 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:41.446581 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:41.456997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:41.458536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:41.459745 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-355c39d3-975b-4179-b021-14bf942e34bd tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.319906 Sep 08 16:22:41.472115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 409/868] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:41 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:41.553651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:41.554338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:41.562708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:41.563164 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:41.564165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:41.564879 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:41.820345 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:41.830799 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f6dd8dc9-5969-4e4d-a0c0-fe16ea3da173 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1593 microversion: 2.1 time: 0.282573 Sep 08 16:22:41.831591 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 460/869] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:41 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1593 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:22:42.482602 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:42.483578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:42.501520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:42.502127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:42.503144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:42.503757 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:43.694333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:43.710848 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:43.712959 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:43.714484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-33c81675-1fe3-48a9-b843-501052d4a007 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 1.238636 Sep 08 16:22:43.725906 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 410/870] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:42 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:44.740304 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:44.744159 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:44.781900 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:44.785970 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:44.787931 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:44.789282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:45.618623 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:45.640580 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:45.643019 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:45.645223 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e5d90ce9-83b0-40f4-a53b-554c248d2022 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.913163 Sep 08 16:22:45.648237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 461/871] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:44 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:46.667056 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:46.668213 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:46.683159 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:46.684392 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:46.685582 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:46.686708 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:47.699673 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:47.710216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:47.711829 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:47.713131 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a7ef23c4-60b4-4030-a03d-57f080623f54 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 1.053583 Sep 08 16:22:47.713724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 411/872] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:46 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:48.115909 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-8eceb9ba-2d10-48da-b1aa-bd6ff4d5fe3a req-18091677-5fac-455f-9b59-6d8a8fa3f9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bdbfb7-ffb6-4948-947a-c946528dd2f4", "tag": "f2af78ec-25e1-4833-a7df-32634ee73ed6"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:48.124459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:22:48.124459 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:22:48.143106 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-8eceb9ba-2d10-48da-b1aa-bd6ff4d5fe3a req-18091677-5fac-455f-9b59-6d8a8fa3f9d6 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:48.144412 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-8eceb9ba-2d10-48da-b1aa-bd6ff4d5fe3a req-18091677-5fac-455f-9b59-6d8a8fa3f9d6 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:48.184728 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-8eceb9ba-2d10-48da-b1aa-bd6ff4d5fe3a req-18091677-5fac-455f-9b59-6d8a8fa3f9d6 service nova] Creating event network-changed:f2af78ec-25e1-4833-a7df-32634ee73ed6 for instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 on hv-cinder-80789 Sep 08 16:22:48.198393 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-8eceb9ba-2d10-48da-b1aa-bd6ff4d5fe3a req-18091677-5fac-455f-9b59-6d8a8fa3f9d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089537 Sep 08 16:22:48.202305 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 462/873] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:22:48.741687 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:48.752016 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:48.787379 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:48.788604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:48.790389 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:48.794842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:49.710388 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:49.786791 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:49.796429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:49.805791 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1bdc7801-4b63-4e87-8773-5b18be0cfc1a tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 1.069168 Sep 08 16:22:49.817237 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 412/874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:48 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:50.847437 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:50.859849 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:50.904508 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:50.905191 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:50.906096 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:50.906637 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:51.348439 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:51.413296 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:51.416773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:51.420127 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-cd046167-e2ff-461b-a0e3-42e8b8278cf7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.583086 Sep 08 16:22:51.422667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 463/875] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:50 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:51.487966 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-201038959"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:51.489124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:51.507030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:51.507914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:51.509477 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:51.510091 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:51.848455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.network.security_group_api [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Adding security group 3c66f6e3-defe-4a07-ad70-a2b00f2c0160 to port f2af78ec-25e1-4833-a7df-32634ee73ed6 Sep 08 16:22:52.461405 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:52.462375 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:52.474119 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:52.474567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:52.475363 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:52.475839 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:52.739823 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0c626ef0-c837-4fc7-adbf-948486fd5dd8 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/action" status: 202 len: 0 microversion: 2.1 time: 1.256923 Sep 08 16:22:52.741316 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 413/876] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:22:51 2021] POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/action => generated 0 bytes in 1259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:22:52.750824 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:52.753023 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:52.765320 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:52.766216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:52.768363 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:52.769228 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:52.974871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:52.987918 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:52.990058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:52.991968 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b8ab847a-3109-46d1-83a4-6db70a0c831b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.534527 Sep 08 16:22:52.993504 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 464/877] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:52 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:53.008248 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-aed6d070-8cdf-4429-9d7e-3bce1ce0d31a req-12c6c587-e4a3-4571-8f01-9ca6734e8c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bdbfb7-ffb6-4948-947a-c946528dd2f4", "tag": "f2af78ec-25e1-4833-a7df-32634ee73ed6"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:22:53.011494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:22:53.011494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:22:53.026618 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-aed6d070-8cdf-4429-9d7e-3bce1ce0d31a req-12c6c587-e4a3-4571-8f01-9ca6734e8c1a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:53.027630 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-aed6d070-8cdf-4429-9d7e-3bce1ce0d31a req-12c6c587-e4a3-4571-8f01-9ca6734e8c1a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:53.051155 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-aed6d070-8cdf-4429-9d7e-3bce1ce0d31a req-12c6c587-e4a3-4571-8f01-9ca6734e8c1a service nova] Creating event network-changed:f2af78ec-25e1-4833-a7df-32634ee73ed6 for instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 on hv-cinder-80789 Sep 08 16:22:53.061265 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-aed6d070-8cdf-4429-9d7e-3bce1ce0d31a req-12c6c587-e4a3-4571-8f01-9ca6734e8c1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061471 Sep 08 16:22:53.062043 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 465/878] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:22:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:22:53.140283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:53.159691 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f55363ca-cc65-4d73-95fb-80669c3f33b4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1639 microversion: 2.1 time: 0.413921 Sep 08 16:22:53.160805 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 414/879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:22:52 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1639 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:22:54.014988 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:54.016466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:54.027170 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:54.028364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:54.029702 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:54.030332 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:54.384771 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:54.402357 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:54.405771 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:54.407348 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9a9300d9-e90e-4b64-97e9-87810252d2c0 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.397782 Sep 08 16:22:54.408528 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 466/880] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:54 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:55.433462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:55.434099 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:55.442411 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:55.442856 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:55.443726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:55.444161 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:55.669414 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:55.681731 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:55.684112 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:55.686144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-59e17e67-1f73-40fa-9fe1-d24e03d3d359 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.256325 Sep 08 16:22:55.687019 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 415/881] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:55 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:22:56.706937 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:56.707937 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:56.717429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:56.717921 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:56.718830 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:56.719305 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:57.060759 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:57.076906 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:57.080311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:57.082312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-887822a1-bb8f-4ec5-bc42-da8063870e9b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.379155 Sep 08 16:22:57.083300 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 467/882] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:56 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:58.116094 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:58.118381 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:58.132605 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:58.134384 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:58.136260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:58.137297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:58.515043 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:58.533221 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:58.536820 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:58.538889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4aa2a498-a9c7-4472-8f3a-463302235da2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.431219 Sep 08 16:22:58.539967 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 416/883] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:58 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:22:59.571950 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:22:59.572708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:22:59.582678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:59.583518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:59.584517 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:22:59.585188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:22:59.821259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:59.831788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:59.833364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:22:59.834540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-074ab954-9cf2-435a-b95e-3c5ab5ea33f2 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.266513 Sep 08 16:22:59.835083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 468/884] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:22:59 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:00.836808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ef403d68-cad6-4b52-a9e1-8532fd60faed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:00.837821 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ef403d68-cad6-4b52-a9e1-8532fd60faed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:00.848065 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef403d68-cad6-4b52-a9e1-8532fd60faed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:00.848732 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef403d68-cad6-4b52-a9e1-8532fd60faed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:00.850110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef403d68-cad6-4b52-a9e1-8532fd60faed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:00.850692 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ef403d68-cad6-4b52-a9e1-8532fd60faed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:00.855769 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:00.856498 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:00.865653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:00.866463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:00.867667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:00.868380 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:00.928827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ef403d68-cad6-4b52-a9e1-8532fd60faed tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.095909 Sep 08 16:23:00.929735 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 417/885] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:23:00 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:23:01.099050 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:01.108329 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:01.109826 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:01.112234 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7c9120ad-cc0c-44bd-a748-e6ddbf1a173b tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.260246 Sep 08 16:23:01.112808 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 469/886] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:00 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:23:01.185068 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7d27c8ea-580a-47b4-ade3-c1aa28bf7e31 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:01.185639 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7d27c8ea-580a-47b4-ade3-c1aa28bf7e31 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:01.194509 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d27c8ea-580a-47b4-ade3-c1aa28bf7e31 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:01.194960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d27c8ea-580a-47b4-ade3-c1aa28bf7e31 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:01.195795 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d27c8ea-580a-47b4-ade3-c1aa28bf7e31 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:01.196240 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d27c8ea-580a-47b4-ade3-c1aa28bf7e31 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:01.268800 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7d27c8ea-580a-47b4-ade3-c1aa28bf7e31 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/9f0dc9f1-100e-45c1-9bf2-01a2e46c64e7" status: 200 len: 194 microversion: 2.1 time: 0.087556 Sep 08 16:23:01.269562 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 418/887] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Sep 8 16:23:01 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/9f0dc9f1-100e-45c1-9bf2-01a2e46c64e7 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:23:01.283229 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:01.283929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:01.298365 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:01.299111 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:01.301223 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:01.302040 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:01.526604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lazy-loading 'services' on Instance uuid 2a8663ba-2359-4629-850a-16db3a5e3798 {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:23:01.678856 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c31d4a93-ad56-4a77-a720-dd064f75c1ad tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/9f0dc9f1-100e-45c1-9bf2-01a2e46c64e7" status: 202 len: 0 microversion: 2.1 time: 0.402427 Sep 08 16:23:01.679497 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 470/888] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:23:01 2021] DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/9f0dc9f1-100e-45c1-9bf2-01a2e46c64e7 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:23:02.132001 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:02.132618 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:02.140801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:02.141468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:02.142882 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:02.143417 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:02.359441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:02.370518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:02.372078 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:02.373241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8c630210-4182-4d4e-b2be-2be034f4e913 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.245270 Sep 08 16:23:02.373802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 419/889] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:02 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:23:02.992376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-c9e268fe-9fc3-4877-9963-92420a64a1ca req-550b79c4-9f87-420b-bc89-94aa2f96d117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5fbdd8-f58c-4d16-be45-d9003f0e770c", "name": "network-vif-plugged", "status": "completed", "tag": "0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:23:02.995744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:23:02.995744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:23:03.015377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-c9e268fe-9fc3-4877-9963-92420a64a1ca req-550b79c4-9f87-420b-bc89-94aa2f96d117 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:03.015999 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-c9e268fe-9fc3-4877-9963-92420a64a1ca req-550b79c4-9f87-420b-bc89-94aa2f96d117 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:03.036724 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-c9e268fe-9fc3-4877-9963-92420a64a1ca req-550b79c4-9f87-420b-bc89-94aa2f96d117 service nova] Creating event network-vif-plugged:0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54 for instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c on hv-cinder-80789 Sep 08 16:23:03.042228 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-c9e268fe-9fc3-4877-9963-92420a64a1ca req-550b79c4-9f87-420b-bc89-94aa2f96d117 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058990 Sep 08 16:23:03.042916 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 471/890] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:23:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:23:03.398372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:03.399242 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:03.408293 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:03.408865 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:03.409817 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:03.410438 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:03.649510 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:03.660507 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:03.661003 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:03.662124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-701f9752-4036-456a-a2ec-5da59b55be2d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.268000 Sep 08 16:23:03.663013 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 420/891] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:03 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:04.694491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:04.695766 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:04.708676 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:04.709354 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:04.710267 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:04.710815 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:05.054492 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:05.068589 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:05.072114 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:05.074269 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ecef280b-98d9-4e97-9eac-84b2157c6d23 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1731 microversion: 2.20 time: 0.396036 Sep 08 16:23:05.075280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 472/892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:04 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1731 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:05.248318 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-b3a23daa-5d11-4d02-b64f-bb3b326feedf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:05.249115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-b3a23daa-5d11-4d02-b64f-bb3b326feedf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:05.259900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b3a23daa-5d11-4d02-b64f-bb3b326feedf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:05.260484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b3a23daa-5d11-4d02-b64f-bb3b326feedf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:05.261720 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b3a23daa-5d11-4d02-b64f-bb3b326feedf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:05.262342 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-b3a23daa-5d11-4d02-b64f-bb3b326feedf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:05.343665 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-b3a23daa-5d11-4d02-b64f-bb3b326feedf tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/351ab47e-29b6-478a-90fa-b06d0cfb54ac" status: 200 len: 194 microversion: 2.1 time: 0.102932 Sep 08 16:23:05.344287 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 421/893] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Sep 8 16:23:05 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/351ab47e-29b6-478a-90fa-b06d0cfb54ac => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:23:05.355065 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:05.355464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:05.365472 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:05.366192 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:05.367090 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:05.367688 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:05.558604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lazy-loading 'services' on Instance uuid 2a8663ba-2359-4629-850a-16db3a5e3798 {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:23:05.801237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-03829d5c-a3b3-4f3c-a882-dd4fab508ead tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/351ab47e-29b6-478a-90fa-b06d0cfb54ac" status: 202 len: 0 microversion: 2.1 time: 0.449931 Sep 08 16:23:05.802130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 473/894] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:23:05 2021] DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments/351ab47e-29b6-478a-90fa-b06d0cfb54ac => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:23:06.097313 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:06.098358 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:06.112689 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:06.113432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:06.115041 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:06.115845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:06.381808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:06.392169 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:06.393759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:06.394951 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4f633ee8-1ddb-45a3-984b-d60a835eb0a4 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1718 microversion: 2.20 time: 0.305111 Sep 08 16:23:06.395576 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 422/895] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:06 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1718 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:07.216835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-115b08ad-dd32-4776-ae22-575592066538 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:07.217905 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-115b08ad-dd32-4776-ae22-575592066538 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:07.228008 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-115b08ad-dd32-4776-ae22-575592066538 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:07.228765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-115b08ad-dd32-4776-ae22-575592066538 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:07.232235 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-115b08ad-dd32-4776-ae22-575592066538 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:07.234753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-115b08ad-dd32-4776-ae22-575592066538 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:07.326296 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-115b08ad-dd32-4776-ae22-575592066538 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114542 Sep 08 16:23:07.326892 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 474/896] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:23:07 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:23:07.560914 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1f4f3211-5001-48c8-932b-b68cb195737f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:07.561911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1f4f3211-5001-48c8-932b-b68cb195737f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:07.570853 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f4f3211-5001-48c8-932b-b68cb195737f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:07.571305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f4f3211-5001-48c8-932b-b68cb195737f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:07.572161 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f4f3211-5001-48c8-932b-b68cb195737f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:07.572608 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f4f3211-5001-48c8-932b-b68cb195737f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:07.660003 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1f4f3211-5001-48c8-932b-b68cb195737f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103360 Sep 08 16:23:07.660598 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 423/897] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:23:07 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:23:07.773610 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:07.774115 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:07.783130 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:07.783769 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:07.784623 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:07.785071 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:07.853625 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:23:08.004824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3cdc8b7b-af54-434a-adc1-660c30d11801 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 204 len: 0 microversion: 2.1 time: 0.234756 Sep 08 16:23:08.005591 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 475/898] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:23:07 2021] DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:23:08.014171 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:08.015137 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:08.023861 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:08.024308 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:08.025103 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:08.025538 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:08.280362 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:08.290216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-95afadec-6e6d-40d1-9a6f-4108b9077cc1 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1672 microversion: 2.1 time: 0.279710 Sep 08 16:23:08.290814 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 424/899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:08 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1672 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:09.309731 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:09.310449 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:09.320740 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:09.321566 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:09.322971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:09.323792 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:09.580123 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:09.589079 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5abae507-f690-490f-a932-5d6bed607821 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1672 microversion: 2.1 time: 0.283410 Sep 08 16:23:09.589673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 476/900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:09 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1672 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:10.607929 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:10.608672 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:10.617518 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:10.617960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:10.618766 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:10.619196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:10.869904 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:10.879602 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c2dbd2d9-cd9f-4cd0-9cb8-5e9b6b743ec2 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1672 microversion: 2.1 time: 0.275312 Sep 08 16:23:10.880845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 425/901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:10 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1672 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:11.909608 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:11.910611 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:11.920979 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:11.921844 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:11.923058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:11.923820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:12.060880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:12.070280 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3a504dee-c6ac-478e-be70-8ddfc3f6eb60 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1605 microversion: 2.1 time: 0.166158 Sep 08 16:23:12.070872 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 477/902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:11 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1605 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:12.448377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-47b6c465-a3a7-448c-b061-55b30485298b req-f3cf4688-f0b7-4b50-8bce-eb60d20b80e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8663ba-2359-4629-850a-16db3a5e3798", "name": "network-vif-deleted", "tag": "d1d984fb-70ca-4008-b36b-e027b27472de"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:23:12.449951 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:23:12.449951 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:23:12.462640 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-47b6c465-a3a7-448c-b061-55b30485298b req-f3cf4688-f0b7-4b50-8bce-eb60d20b80e5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:12.463414 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-47b6c465-a3a7-448c-b061-55b30485298b req-f3cf4688-f0b7-4b50-8bce-eb60d20b80e5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:12.482917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-47b6c465-a3a7-448c-b061-55b30485298b req-f3cf4688-f0b7-4b50-8bce-eb60d20b80e5 service nova] Creating event network-vif-deleted:d1d984fb-70ca-4008-b36b-e027b27472de for instance 2a8663ba-2359-4629-850a-16db3a5e3798 on hv-cinder-80789 Sep 08 16:23:12.490311 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-47b6c465-a3a7-448c-b061-55b30485298b req-f3cf4688-f0b7-4b50-8bce-eb60d20b80e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046427 Sep 08 16:23:12.490909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 426/903] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:23:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:23:13.090078 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:13.091880 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:13.103784 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:13.104271 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:13.105075 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:13.105557 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:13.258670 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:13.259579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:13.261512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lazy-loading 'fault' on Instance uuid 2a8663ba-2359-4629-850a-16db3a5e3798 {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:23:13.334482 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fe3a59305f044fa87cd6a1cb91d8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212c97f3a57a4db5985bce4f60183ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:13.343025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a1f65e17-04c6-41c9-99a5-7dc70de4644f tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 200 len: 1328 microversion: 2.1 time: 0.258221 Sep 08 16:23:13.343639 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 478/904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:13 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 1328 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:14.365000 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:14.365878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:14.374142 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:14.374597 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:14.375413 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:14.376591 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:14.434651 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] HTTP exception thrown: Instance 2a8663ba-2359-4629-850a-16db3a5e3798 could not be found. Sep 08 16:23:14.435243 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Returning 404 to user: Instance 2a8663ba-2359-4629-850a-16db3a5e3798 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:14.436143 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-627bb346-fd68-4d70-a378-c192f6ed4ea8 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 404 len: 111 microversion: 2.1 time: 0.078066 Sep 08 16:23:14.436726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 427/905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:14 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:23:14.446608 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-54eba022-1a7a-4fe9-bef0-0e6691b9a62b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '.version_select at 0x7f3704406670>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:14.466209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-54eba022-1a7a-4fe9-bef0-0e6691b9a62b tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064233452" status: 202 len: 0 microversion: 2.1 time: 0.023443 Sep 08 16:23:14.466865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 479/906] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Sep 8 16:23:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064233452 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:23:15.693564 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8581c532-db87-41c6-aaaf-cb3a6d0fa109 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:23:15.694057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8581c532-db87-41c6-aaaf-cb3a6d0fa109 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:15.714433 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8581c532-db87-41c6-aaaf-cb3a6d0fa109 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:15.715204 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8581c532-db87-41c6-aaaf-cb3a6d0fa109 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:15.716439 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8581c532-db87-41c6-aaaf-cb3a6d0fa109 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:15.717437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8581c532-db87-41c6-aaaf-cb3a6d0fa109 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:15.978364 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8581c532-db87-41c6-aaaf-cb3a6d0fa109 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/action" status: 202 len: 0 microversion: 2.1 time: 0.289647 Sep 08 16:23:15.979308 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 428/907] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:23:15 2021] POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:23:16.002765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:16.002765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:16.002765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:16.002765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:16.003954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:16.003954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:16.270445 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:16.288840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-28504c65-a281-48ae-b531-de4ec805df43 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1750 microversion: 2.1 time: 0.304767 Sep 08 16:23:16.289934 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 480/908] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:15 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1750 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:17.315707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:17.316616 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:17.325146 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:17.325653 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:17.326632 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:17.327069 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:17.716743 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:17.727660 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3a0437a5-2fdf-43e1-9be5-dfd33a1238af tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1750 microversion: 2.1 time: 0.416677 Sep 08 16:23:17.728244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 429/909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:17 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1750 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:18.374736 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:18.375371 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:18.383663 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:18.384113 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:18.384902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:18.385333 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:18.437394 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] HTTP exception thrown: Instance 2a8663ba-2359-4629-850a-16db3a5e3798 could not be found. Sep 08 16:23:18.437990 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Returning 404 to user: Instance 2a8663ba-2359-4629-850a-16db3a5e3798 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:18.439641 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4a381c55-fe5a-4221-ba1f-3efe8ff89636 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 404 len: 111 microversion: 2.1 time: 0.068669 Sep 08 16:23:18.440198 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 481/910] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:23:18 2021] DELETE /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:23:18.450184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:18.451028 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 2a8663ba-2359-4629-850a-16db3a5e3798] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:18.459222 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:18.460022 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:18.460831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:18.461276 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:18.516578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] HTTP exception thrown: Instance 2a8663ba-2359-4629-850a-16db3a5e3798 could not be found. Sep 08 16:23:18.516937 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Returning 404 to user: Instance 2a8663ba-2359-4629-850a-16db3a5e3798 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:18.517800 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1f3a0343-c40d-429c-9e9b-43dadabc243c tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798" status: 404 len: 111 microversion: 2.1 time: 0.072035 Sep 08 16:23:18.518374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 430/911] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:18 2021] GET /compute/v2.1/servers/2a8663ba-2359-4629-850a-16db3a5e3798 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:23:18.757052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:18.757667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:18.765210 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:18.765665 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:18.767221 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:18.767815 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:19.017891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:19.027269 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-21760e3b-a6de-437f-984f-3c36eaba92d7 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.274217 Sep 08 16:23:19.027892 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 482/912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:18 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:19.765113 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:19.765789 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:19.774181 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:19.774627 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:19.775421 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:19.775885 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:19.830501 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] HTTP exception thrown: Instance 3db24e43-208d-4d9e-a75c-98f3168ab156 could not be found. Sep 08 16:23:19.831102 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Returning 404 to user: Instance 3db24e43-208d-4d9e-a75c-98f3168ab156 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:19.831977 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-eb6a3e7b-1f03-44e5-9055-1e18c844252e tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 404 len: 111 microversion: 2.1 time: 0.071690 Sep 08 16:23:19.832552 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 431/913] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:23:19 2021] DELETE /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:23:19.841145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:19.841759 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] [instance: 3db24e43-208d-4d9e-a75c-98f3168ab156] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:19.850556 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:19.850993 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:19.851821 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:19.852254 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:19.909492 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] HTTP exception thrown: Instance 3db24e43-208d-4d9e-a75c-98f3168ab156 could not be found. Sep 08 16:23:19.910291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] Returning 404 to user: Instance 3db24e43-208d-4d9e-a75c-98f3168ab156 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:19.911189 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6ee89c6c-bef7-4b01-9458-867bddc574f9 tempest-AttachVolumeTestJSON-1630356961 tempest-AttachVolumeTestJSON-1630356961-project] 10.222.0.25 "GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156" status: 404 len: 111 microversion: 2.1 time: 0.074025 Sep 08 16:23:19.911904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 483/914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:19 2021] GET /compute/v2.1/servers/3db24e43-208d-4d9e-a75c-98f3168ab156 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:23:20.048995 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:20.049910 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:20.062164 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:20.062910 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:20.064972 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:20.065704 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:20.665377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:20.675900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-64a91622-f0eb-442a-9edd-2e0c2ac20798 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.633277 Sep 08 16:23:20.676693 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 432/915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:20 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:21.695068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:21.696527 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:21.709379 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:21.710005 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:21.711282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:21.711909 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:22.536490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:22.554526 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a20971c7-071c-4803-a375-6708c84028dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.863142 Sep 08 16:23:22.558097 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 484/916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:21 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:23.581200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:23.582132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:23.589755 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:23.590193 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:23.591183 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:23.591661 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:23.880288 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:23.892435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-14cf4a23-1f0c-4dad-a3aa-a12ee23728dc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.314677 Sep 08 16:23:23.893481 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 433/917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:23 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:24.926757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:24.928125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:24.940160 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:24.940824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:24.941689 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:24.943255 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:25.305762 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:25.324591 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-831b60d3-e47b-4034-b9bd-14e849659a4b tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.404636 Sep 08 16:23:25.326196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 485/918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:24 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:26.355434 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:26.356384 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:26.365435 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:26.365889 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:26.366743 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:26.367180 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:27.052360 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:27.062531 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-eabd567b-17e1-4dee-a132-59ffafe6fe39 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.712110 Sep 08 16:23:27.063304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 434/919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:26 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:28.084560 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:28.085174 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:28.092653 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:28.093099 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:28.093883 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:28.094339 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:28.357029 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:28.368709 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fddc6843-f654-48a0-a8fc-e70b4ec13b22 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.287738 Sep 08 16:23:28.369377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 486/920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:28 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:29.387492 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:29.388514 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:29.397645 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:29.398270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:29.398908 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:29.399428 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:29.789238 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:29.806770 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-17109729-d0cf-44af-a6ef-aee08498cddd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.423568 Sep 08 16:23:29.807866 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 435/921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:29 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:30.837182 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:30.839953 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:30.866705 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:30.867932 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:30.870338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:30.871925 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:31.731734 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:31.752016 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f6e161eb-808e-45ab-9ad3-0f4dd6410c70 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.928366 Sep 08 16:23:31.753530 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 487/922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:30 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:32.732900 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:32.736319 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:32.746714 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-d9a4f438-1a6d-4bef-bdd3-6cae435326e6 req-162b5c6a-5baf-47bd-893b-ba7800422c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3b840e-551f-45cd-bbb8-079394ec0f1a", "tag": "6d93681d-822b-4cdf-8b2f-08faccca27db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:23:32.752466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:23:32.752466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:23:32.755217 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:32.757851 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:32.759375 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:32.760428 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:32.806296 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d9a4f438-1a6d-4bef-bdd3-6cae435326e6 req-162b5c6a-5baf-47bd-893b-ba7800422c1a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:32.807518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-d9a4f438-1a6d-4bef-bdd3-6cae435326e6 req-162b5c6a-5baf-47bd-893b-ba7800422c1a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:32.894107 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-d9a4f438-1a6d-4bef-bdd3-6cae435326e6 req-162b5c6a-5baf-47bd-893b-ba7800422c1a service nova] Creating event network-changed:6d93681d-822b-4cdf-8b2f-08faccca27db for instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a on hv-cinder-80789 Sep 08 16:23:32.918141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-d9a4f438-1a6d-4bef-bdd3-6cae435326e6 req-162b5c6a-5baf-47bd-893b-ba7800422c1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180300 Sep 08 16:23:32.924001 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 488/923] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:23:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:23:32.943230 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:32.957478 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:32.974672 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:32.992713 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:32.994097 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:32.995045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:33.010855 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:23:33.484978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-36205b59-8dea-46ac-b292-2a9288c248ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 204 len: 0 microversion: 2.1 time: 0.758265 Sep 08 16:23:33.488075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 436/924] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:23:32 2021] DELETE /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 0 bytes in 767 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:23:33.510723 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:33.511856 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:33.551667 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:33.552334 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:33.554252 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:33.554991 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:33.924573 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:33.955788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ac03f1f1-4aa2-4d43-8eb5-e7fea25abffd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 1.027525 Sep 08 16:23:33.959115 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 489/925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:32 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:34.268444 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:34.285604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8a657bc3-d2d5-49bd-bf49-555532d4f239 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1568 microversion: 2.1 time: 0.791429 Sep 08 16:23:34.286883 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 437/926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:33 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1568 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:34.977342 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:34.978197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:34.986786 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:34.987579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:34.988562 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:34.989002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:35.305432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:35.306456 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:35.315097 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:35.315817 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:35.316743 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:35.317281 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:35.831534 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:35.850310 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dcd0ab42-c309-4836-ba7a-fc8b8fafff38 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.876604 Sep 08 16:23:35.851923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 490/927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:34 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:35.968680 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:35.983919 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4ae89628-913a-4330-8b31-5a15b664ddb2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1449 microversion: 2.1 time: 0.682274 Sep 08 16:23:35.984918 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 438/928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:35 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1449 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:36.684040 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-893957fc-c120-4bce-8134-a345050628a0 req-00de68a2-1f90-43e7-9dfe-09ab01840b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3b840e-551f-45cd-bbb8-079394ec0f1a", "name": "network-vif-deleted", "tag": "6d93681d-822b-4cdf-8b2f-08faccca27db"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:23:36.687708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:23:36.687708 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:23:36.702883 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-893957fc-c120-4bce-8134-a345050628a0 req-00de68a2-1f90-43e7-9dfe-09ab01840b42 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:36.705963 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-893957fc-c120-4bce-8134-a345050628a0 req-00de68a2-1f90-43e7-9dfe-09ab01840b42 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:36.734557 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-893957fc-c120-4bce-8134-a345050628a0 req-00de68a2-1f90-43e7-9dfe-09ab01840b42 service nova] Creating event network-vif-deleted:6d93681d-822b-4cdf-8b2f-08faccca27db for instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a on hv-cinder-80789 Sep 08 16:23:36.742329 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-893957fc-c120-4bce-8134-a345050628a0 req-00de68a2-1f90-43e7-9dfe-09ab01840b42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063117 Sep 08 16:23:36.742958 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 491/929] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:23:36.873184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:36.874096 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:36.889260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:36.890049 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:36.891656 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:36.892521 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:37.010652 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:37.012676 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:37.028059 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:37.029379 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:37.031204 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:37.032425 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:37.421576 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:37.424160 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:37.435496 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ed8644fe-3151-4df0-8af2-16a9f3e8a345 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1219 microversion: 2.1 time: 0.435223 Sep 08 16:23:37.436292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 492/930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:36 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1219 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:37.439126 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-cc8caa20-8dc4-4a99-b95b-f9171132992c tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.572581 Sep 08 16:23:37.440508 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 439/931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:36 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:38.465571 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:38.467286 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:38.487315 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:38.488405 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:38.502168 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:38.505116 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:38.508674 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:38.510172 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:38.511494 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:38.512570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:38.514775 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:38.515880 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:38.749643 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:38.754689 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:38.757465 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lazy-loading 'fault' on Instance uuid 0a3b840e-551f-45cd-bbb8-079394ec0f1a {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:23:38.958201 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253dd37a73cd4c5190fb30c9ac3885ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192ebea3f6246118edb985b970044bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:38.966398 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c5cbf175-5137-4b4a-8eee-21af140905ac tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 200 len: 1178 microversion: 2.1 time: 0.507148 Sep 08 16:23:38.967369 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 493/932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:38 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 1178 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:39.086703 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:39.098813 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-32706464-ca45-4099-82fe-fab8121be876 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1755 microversion: 2.1 time: 0.624638 Sep 08 16:23:39.099828 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 440/933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:38 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1755 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:39.857077 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b7acad64-329b-4cdd-8872-09505949265c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:39.858495 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b7acad64-329b-4cdd-8872-09505949265c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:39.869002 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b7acad64-329b-4cdd-8872-09505949265c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:39.869615 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b7acad64-329b-4cdd-8872-09505949265c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:39.870871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b7acad64-329b-4cdd-8872-09505949265c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:39.871431 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b7acad64-329b-4cdd-8872-09505949265c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:39.957162 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b7acad64-329b-4cdd-8872-09505949265c tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.104423 Sep 08 16:23:39.959681 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 494/934] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Sep 8 16:23:39 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:23:39.996969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:39.997773 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [instance: 0a3b840e-551f-45cd-bbb8-079394ec0f1a] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:40.010219 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.011424 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.013115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.013802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.106075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] HTTP exception thrown: Instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a could not be found. Sep 08 16:23:40.106075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Returning 404 to user: Instance 0a3b840e-551f-45cd-bbb8-079394ec0f1a could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:40.106075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8834d3d4-0cd4-44a6-8586-febd8c98e2d2 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a" status: 404 len: 111 microversion: 2.1 time: 0.108790 Sep 08 16:23:40.106075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 441/935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:39 2021] GET /compute/v2.1/servers/0a3b840e-551f-45cd-bbb8-079394ec0f1a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:23:40.115581 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:40.116451 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:40.130272 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:40.131233 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:40.131421 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.132173 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.133544 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.134517 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.141095 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.142307 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.143263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.143836 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.263368 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:23:40.510830 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-18a1eed9-d6b1-41da-a961-e6d6c7b30a72 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 204 len: 0 microversion: 2.20 time: 0.402348 Sep 08 16:23:40.512016 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 495/936] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Sep 8 16:23:40 2021] DELETE /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:23:40.523371 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:40.524780 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:40.538257 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.539104 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.540616 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:40.541336 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:40.661442 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:40.677234 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9aab1f24-926a-4f40-8855-4dd9bfac5dec tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1758 microversion: 2.1 time: 0.554542 Sep 08 16:23:40.695754 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 442/937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:40 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1758 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:23:40.805094 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-94177a25-9c7f-4199-aa32-c005ef7adb28 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] Calling method '.version_select at 0x7f3704663a60>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:40.808805 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94177a25-9c7f-4199-aa32-c005ef7adb28 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [8fba3571-fed9-49a1-a30d-f07c0f946e87] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 16:23:40.874057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:40.879902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:40.881517 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:40.882688 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f4caac6e-1591-4b93-aeb7-c416490e2d75 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.365105 Sep 08 16:23:40.883441 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 496/938] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:40 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:41.835613 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [None req-94177a25-9c7f-4199-aa32-c005ef7adb28 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] [8fba3571-fed9-49a1-a30d-f07c0f946e87] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33344. Sep 08 16:23:41.860760 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-94177a25-9c7f-4199-aa32-c005ef7adb28 tempest-TestShelveInstance-435153846 tempest-TestShelveInstance-435153846-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1491269323" status: 202 len: 0 microversion: 2.1 time: 1.058762 Sep 08 16:23:41.862001 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 443/939] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Sep 8 16:23:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1491269323 => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:23:41.916489 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:41.917131 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:41.946661 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:41.950302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:41.952352 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:41.953530 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:42.581415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:42.591501 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:42.593325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:42.594633 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4b566ca2-6996-40f5-a3b1-d860d78ea21d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.688097 Sep 08 16:23:42.595352 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 497/940] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:41 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:43.619977 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:43.621071 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:43.631316 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:43.633360 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:43.634424 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:43.634898 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:44.300767 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:44.311140 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:44.312839 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:44.315615 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6d101176-2e8f-4f1c-96d7-39b63c5e8bd7 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1724 microversion: 2.20 time: 0.704274 Sep 08 16:23:44.316661 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 444/941] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:43 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1724 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:45.341645 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:45.352814 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-42c14236-6171-4ad4-bf7b-c4303f99ad3f req-62aef9da-e749-4cd5-b49f-ba1300b8db7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5fbdd8-f58c-4d16-be45-d9003f0e770c", "name": "network-vif-deleted", "tag": "0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:23:45.354642 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:45.362586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:23:45.362586 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:23:45.383053 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:45.383833 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:45.385205 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:45.386141 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:45.387707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-42c14236-6171-4ad4-bf7b-c4303f99ad3f req-62aef9da-e749-4cd5-b49f-ba1300b8db7a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:45.388442 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-42c14236-6171-4ad4-bf7b-c4303f99ad3f req-62aef9da-e749-4cd5-b49f-ba1300b8db7a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:45.428573 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-42c14236-6171-4ad4-bf7b-c4303f99ad3f req-62aef9da-e749-4cd5-b49f-ba1300b8db7a service nova] Creating event network-vif-deleted:0356e4ab-a2b3-48cc-b0e8-9e89a65d6c54 for instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c on hv-cinder-80789 Sep 08 16:23:45.453029 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-42c14236-6171-4ad4-bf7b-c4303f99ad3f req-62aef9da-e749-4cd5-b49f-ba1300b8db7a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096406 Sep 08 16:23:45.460225 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 445/942] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:23:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:23:45.790984 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:45.804394 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:45.806425 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b8e261b03145bbbb513a7044de5211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8151b8f5193c4e4eb58002780ae62270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:23:45.807951 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-d31f167b-af2d-4720-90dd-752649841656 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 200 len: 1367 microversion: 2.20 time: 0.475327 Sep 08 16:23:45.819676 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 498/943] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:45 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:23:46.831272 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:46.834432 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:46.853037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:46.854332 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:46.856077 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:46.857088 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:46.995498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] HTTP exception thrown: Instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c could not be found. Sep 08 16:23:46.997387 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Returning 404 to user: Instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:46.999520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-72841b40-cd7f-4fd7-a5f3-54f5b14defc1 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 404 len: 111 microversion: 2.20 time: 0.175738 Sep 08 16:23:47.002086 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 446/944] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Sep 8 16:23:46 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:23:47.019152 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-44bfb93b-1b96-490f-9814-e815cbad2487 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '.version_select at 0x7f3704406550>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:47.089791 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-44bfb93b-1b96-490f-9814-e815cbad2487 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184396738" status: 204 len: 0 microversion: 2.20 time: 0.080494 Sep 08 16:23:47.090886 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 499/945] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Sep 8 16:23:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184396738 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:23:50.423196 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:50.424415 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:50.435988 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:50.436727 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:50.437915 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:50.438540 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:50.496742 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] HTTP exception thrown: Instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c could not be found. Sep 08 16:23:50.497689 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Returning 404 to user: Instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:50.498711 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-12684f72-349a-4683-8c40-39a1a96febb9 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 404 len: 111 microversion: 2.1 time: 0.079772 Sep 08 16:23:50.499830 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 447/946] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:23:50 2021] DELETE /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:23:50.508287 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:50.510218 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: 1c5fbdd8-f58c-4d16-be45-d9003f0e770c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:50.520301 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:50.521466 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:50.523545 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:50.525029 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:50.627444 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] HTTP exception thrown: Instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c could not be found. Sep 08 16:23:50.628569 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Returning 404 to user: Instance 1c5fbdd8-f58c-4d16-be45-d9003f0e770c could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:50.629595 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6b9d9056-b657-4421-9472-1ab812740aa5 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c" status: 404 len: 111 microversion: 2.1 time: 0.125228 Sep 08 16:23:50.630864 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 500/947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:50 2021] GET /compute/v2.1/servers/1c5fbdd8-f58c-4d16-be45-d9003f0e770c => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:23:51.865537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:23:51.866584 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:23:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:23:52.012326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:52.013423 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:52.033676 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:52.034468 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:52.036612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:52.037387 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:52.131520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] HTTP exception thrown: Instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d could not be found. Sep 08 16:23:52.132209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Returning 404 to user: Instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:52.133112 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-67324170-4cbd-4d1b-af56-c7ab12011340 tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 404 len: 111 microversion: 2.1 time: 0.128465 Sep 08 16:23:52.134304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 448/948] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:23:52 2021] DELETE /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:23:52.148903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:23:52.150598 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] [instance: b2dd36a3-a4b2-4d0e-8140-e629d0c9954d] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:23:52.162575 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:52.163054 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:52.164059 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:23:52.164494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:23:52.217031 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] HTTP exception thrown: Instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d could not be found. Sep 08 16:23:52.217621 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] Returning 404 to user: Instance b2dd36a3-a4b2-4d0e-8140-e629d0c9954d could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:23:52.218468 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8e2e23dc-b90d-43ae-8e7d-fc44edf8c53d tempest-AttachVolumeShelveTestJSON-1384134545 tempest-AttachVolumeShelveTestJSON-1384134545-project] 10.222.0.25 "GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d" status: 404 len: 111 microversion: 2.1 time: 0.079987 Sep 08 16:23:52.219056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 501/949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:23:52 2021] GET /compute/v2.1/servers/b2dd36a3-a4b2-4d0e-8140-e629d0c9954d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:24:14.452244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-201038959"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:24:14.453134 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:14.462760 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:14.463346 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:14.464383 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:14.465002 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:14.725284 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.network.security_group_api [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Removing security group 3c66f6e3-defe-4a07-ad70-a2b00f2c0160 from port f2af78ec-25e1-4833-a7df-32634ee73ed6 Sep 08 16:24:15.444801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-214630df-473d-4280-829e-9eccaddc51fc tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/action" status: 202 len: 0 microversion: 2.1 time: 0.996430 Sep 08 16:24:15.448179 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 449/950] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Sep 8 16:24:14 2021] POST /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/action => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:24:15.465390 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-a1c7aea7-59b2-4ca4-8bc5-7d48d6748883 req-8e775ea8-68de-4503-aa90-5ff332d3ad7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bdbfb7-ffb6-4948-947a-c946528dd2f4", "tag": "f2af78ec-25e1-4833-a7df-32634ee73ed6"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:24:15.472721 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:24:15.472721 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:24:15.528703 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-a1c7aea7-59b2-4ca4-8bc5-7d48d6748883 req-8e775ea8-68de-4503-aa90-5ff332d3ad7e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:15.529893 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-a1c7aea7-59b2-4ca4-8bc5-7d48d6748883 req-8e775ea8-68de-4503-aa90-5ff332d3ad7e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:15.582294 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-a1c7aea7-59b2-4ca4-8bc5-7d48d6748883 req-8e775ea8-68de-4503-aa90-5ff332d3ad7e service nova] Creating event network-changed:f2af78ec-25e1-4833-a7df-32634ee73ed6 for instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 on hv-cinder-80789 Sep 08 16:24:15.603849 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-a1c7aea7-59b2-4ca4-8bc5-7d48d6748883 req-8e775ea8-68de-4503-aa90-5ff332d3ad7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151483 Sep 08 16:24:15.604539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 502/951] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:24:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:24:17.586892 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:17.589129 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:17.603934 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:17.604758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:17.606131 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:17.606911 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:17.624904 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-827e3264-7c02-4008-94cd-633f58fce7aa req-8a16f94a-54fe-4128-a818-d442c45c0907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98bdbfb7-ffb6-4948-947a-c946528dd2f4", "tag": "f2af78ec-25e1-4833-a7df-32634ee73ed6"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:24:17.627891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:24:17.627891 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:24:17.638391 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-827e3264-7c02-4008-94cd-633f58fce7aa req-8a16f94a-54fe-4128-a818-d442c45c0907 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:17.639266 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-827e3264-7c02-4008-94cd-633f58fce7aa req-8a16f94a-54fe-4128-a818-d442c45c0907 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:17.658853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-827e3264-7c02-4008-94cd-633f58fce7aa req-8a16f94a-54fe-4128-a818-d442c45c0907 service nova] Creating event network-changed:f2af78ec-25e1-4833-a7df-32634ee73ed6 for instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 on hv-cinder-80789 Sep 08 16:24:17.664445 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-827e3264-7c02-4008-94cd-633f58fce7aa req-8a16f94a-54fe-4128-a818-d442c45c0907 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045617 Sep 08 16:24:17.665338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 503/952] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:24:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:24:17.926688 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lazy-loading 'services' on Instance uuid 98bdbfb7-ffb6-4948-947a-c946528dd2f4 {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:24:18.129937 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-dd446af6-72a4-414e-a6cd-c466df2bff2e tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments/97f37573-a0b6-4a3b-807a-0593d1675c52" status: 202 len: 0 microversion: 2.1 time: 0.550590 Sep 08 16:24:18.130536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 450/953] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:24:17 2021] DELETE /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments/97f37573-a0b6-4a3b-807a-0593d1675c52 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:24:18.141494 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b0e2a20e-be1c-4bc3-9d1b-58ba09c77239 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:18.142552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b0e2a20e-be1c-4bc3-9d1b-58ba09c77239 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:18.150604 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b0e2a20e-be1c-4bc3-9d1b-58ba09c77239 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:18.151154 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b0e2a20e-be1c-4bc3-9d1b-58ba09c77239 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:18.152085 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b0e2a20e-be1c-4bc3-9d1b-58ba09c77239 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:18.152595 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b0e2a20e-be1c-4bc3-9d1b-58ba09c77239 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:18.223890 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b0e2a20e-be1c-4bc3-9d1b-58ba09c77239 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088271 Sep 08 16:24:18.224806 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 504/954] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:24:18 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:24:19.237902 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-875c9564-f757-4c43-8b3a-7be01318cd3a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:19.239930 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-875c9564-f757-4c43-8b3a-7be01318cd3a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:19.248715 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-875c9564-f757-4c43-8b3a-7be01318cd3a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:19.249260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-875c9564-f757-4c43-8b3a-7be01318cd3a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:19.250720 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-875c9564-f757-4c43-8b3a-7be01318cd3a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:19.251549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-875c9564-f757-4c43-8b3a-7be01318cd3a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:19.323715 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-875c9564-f757-4c43-8b3a-7be01318cd3a tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091149 Sep 08 16:24:19.324612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 451/955] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:24:19 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:24:20.336367 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e330e356-7ccb-43c4-a877-cb195e7c89cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:20.338073 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e330e356-7ccb-43c4-a877-cb195e7c89cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:20.347304 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e330e356-7ccb-43c4-a877-cb195e7c89cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:20.348262 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e330e356-7ccb-43c4-a877-cb195e7c89cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:20.349127 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e330e356-7ccb-43c4-a877-cb195e7c89cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:20.349814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e330e356-7ccb-43c4-a877-cb195e7c89cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:20.431807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e330e356-7ccb-43c4-a877-cb195e7c89cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099843 Sep 08 16:24:20.432719 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 505/956] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Sep 8 16:24:20 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 16:24:20.448170 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:20.448976 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:20.462520 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:20.463123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:20.464110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:20.464958 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:20.689778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] HTTP exception thrown: Instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 is not attached to volume 97f37573-a0b6-4a3b-807a-0593d1675c52 Sep 08 16:24:20.690398 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Returning 404 to user: Instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 is not attached to volume 97f37573-a0b6-4a3b-807a-0593d1675c52 {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:24:20.691260 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7d627c14-a1a1-4cd3-9918-8a6969038813 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments/97f37573-a0b6-4a3b-807a-0593d1675c52" status: 404 len: 154 microversion: 2.1 time: 0.251492 Sep 08 16:24:20.691891 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 452/957] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:24:20 2021] DELETE /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4/os-volume_attachments/97f37573-a0b6-4a3b-807a-0593d1675c52 => generated 154 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:24:24.169744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:24.170450 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:24.178420 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:24.178866 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:24.179694 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:24.180131 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:24.245063 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:24:24.389132 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4178e9f3-96ad-47f5-80ee-c28eeba110dd tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 204 len: 0 microversion: 2.1 time: 0.222784 Sep 08 16:24:24.390181 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 506/958] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:24:24 2021] DELETE /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:24:24.403244 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:24.404325 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:24.417374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:24.418385 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:24.419830 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:24.420655 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:24.835762 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:24:24.856999 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2d70926d-4eaa-4fe4-9e2a-6a59cf930144 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1553 microversion: 2.1 time: 0.460021 Sep 08 16:24:24.858082 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 453/959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:24 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1553 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:24:25.883010 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:25.884181 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:25.898643 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:25.899908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:25.901650 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:25.902461 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:26.219567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:24:26.227913 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-03918430-1728-442e-949c-e44216fd8ca2 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1553 microversion: 2.1 time: 0.352047 Sep 08 16:24:26.228510 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 507/960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:25 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1553 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:24:27.245354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:27.245992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:27.254820 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:27.255429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:27.256263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:27.256693 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:27.472681 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:24:27.481965 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-8758c697-b4c8-452c-b439-0453e2a7322f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1553 microversion: 2.1 time: 0.240108 Sep 08 16:24:27.482469 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 454/961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:27 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:24:28.501918 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:28.502592 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:28.511111 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:28.511741 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:28.512654 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:28.513188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:29.028444 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:24:29.041870 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dae2c4c1-d1e3-4f48-8bb5-cc0d98de2f48 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1553 microversion: 2.1 time: 0.544778 Sep 08 16:24:29.043787 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 508/962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:28 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1553 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:24:29.920098 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-f29b20a7-7981-408c-9292-421fb2f1c4ea req-315c9c8e-a567-4688-b62a-9adf41caeee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98bdbfb7-ffb6-4948-947a-c946528dd2f4", "name": "network-vif-deleted", "tag": "f2af78ec-25e1-4833-a7df-32634ee73ed6"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:24:29.921778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:24:29.921778 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:24:29.936446 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f29b20a7-7981-408c-9292-421fb2f1c4ea req-315c9c8e-a567-4688-b62a-9adf41caeee4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:29.937251 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f29b20a7-7981-408c-9292-421fb2f1c4ea req-315c9c8e-a567-4688-b62a-9adf41caeee4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:29.964312 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-f29b20a7-7981-408c-9292-421fb2f1c4ea req-315c9c8e-a567-4688-b62a-9adf41caeee4 service nova] Creating event network-vif-deleted:f2af78ec-25e1-4833-a7df-32634ee73ed6 for instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 on hv-cinder-80789 Sep 08 16:24:29.976381 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-f29b20a7-7981-408c-9292-421fb2f1c4ea req-315c9c8e-a567-4688-b62a-9adf41caeee4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058089 Sep 08 16:24:29.978265 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 455/963] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:24:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:24:30.068824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:30.069996 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:30.084882 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:30.086097 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:30.088075 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:30.089183 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:30.217161 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:30.217835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:30.218455 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lazy-loading 'fault' on Instance uuid 98bdbfb7-ffb6-4948-947a-c946528dd2f4 {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:24:30.303134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:24:30.312228 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-2ae3ca88-7757-4283-85f9-dcae127704cb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1347 microversion: 2.1 time: 0.251349 Sep 08 16:24:30.313552 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 509/964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:30 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1347 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:24:31.334121 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:31.334855 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:31.342810 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:31.343261 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:31.344214 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:31.344658 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:31.431322 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:31.431803 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:31.432278 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.objects.instance [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lazy-loading 'fault' on Instance uuid 98bdbfb7-ffb6-4948-947a-c946528dd2f4 {{(pid=93617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:24:31.492009 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:24:31.502294 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-0c669b82-6a3f-442b-872e-4871db3f57bb tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1347 microversion: 2.1 time: 0.172404 Sep 08 16:24:31.503018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 456/965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:31 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1347 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:24:32.520322 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:32.521238 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:32.529133 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:32.529572 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:32.530354 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:32.530779 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:32.602081 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:32.602520 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:32.602970 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lazy-loading 'fault' on Instance uuid 98bdbfb7-ffb6-4948-947a-c946528dd2f4 {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:24:32.666546 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dada2bb3054a58ae5b38d4579475c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73141861083d409898791956fbfb9619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:24:32.675788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-4f4c0325-ec98-4247-879c-5105e1280ac0 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 200 len: 1347 microversion: 2.1 time: 0.159939 Sep 08 16:24:32.676400 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 510/966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:32 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 1347 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:24:33.697044 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:33.698174 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] [instance: 98bdbfb7-ffb6-4948-947a-c946528dd2f4] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:24:33.712930 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:33.713759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:33.715318 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:24:33.716162 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:24:33.831699 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] HTTP exception thrown: Instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 could not be found. Sep 08 16:24:33.832828 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Returning 404 to user: Instance 98bdbfb7-ffb6-4948-947a-c946528dd2f4 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:24:33.834328 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-94c97fbb-7d05-4cc4-9640-a296a16d641f tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4" status: 404 len: 111 microversion: 2.1 time: 0.143977 Sep 08 16:24:33.835348 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 457/967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:24:33 2021] GET /compute/v2.1/servers/98bdbfb7-ffb6-4948-947a-c946528dd2f4 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:24:33.844260 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3f84b80c-8bd5-4033-ba53-9bafaef661c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] Calling method '.version_select at 0x7f3704308ca0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:24:33.866290 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3f84b80c-8bd5-4033-ba53-9bafaef661c4 tempest-TestMinimumBasicScenario-1561884331 tempest-TestMinimumBasicScenario-1561884331-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-915259818" status: 202 len: 0 microversion: 2.1 time: 0.025167 Sep 08 16:24:33.867651 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 511/968] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Sep 8 16:24:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-915259818 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:25:03.711487 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1245349997", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "e4fe72d6-9de9-4d22-bc86-742563af7824"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:25:03.987917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] validate_networks() for [('e4fe72d6-9de9-4d22-bc86-742563af7824', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:25:04.598828 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:25:04.599700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:25:04.600682 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:25:04.601512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:25:04.602694 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:25:04.619200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:04.620163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:04.621800 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:04.622599 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:04.657263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Getting quotas for project e174abb16dc144848c118fcce03c19f8. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:25:04.665371 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Getting quotas for user c447b979ec0c4f919d82694e1a67bc6f and project e174abb16dc144848c118fcce03c19f8. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:25:04.684235 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:25:04.686610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:25:04.740694 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-675e17af-6aaa-4e59-9b91-8a5d383f95ed tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032855 Sep 08 16:25:04.741930 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 458/969] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:25:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:25:04.750139 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 16:25:04.753689 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-6a5e22de-cba8-45b4-aac0-4b2b01eecac2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:04.754295 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-6a5e22de-cba8-45b4-aac0-4b2b01eecac2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:04.878613 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-6a5e22de-cba8-45b4-aac0-4b2b01eecac2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:04.897929 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-6a5e22de-cba8-45b4-aac0-4b2b01eecac2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1219 microversion: 2.1 time: 0.149386 Sep 08 16:25:04.912075 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 512/970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:04 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:25:05.925528 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:05.926354 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:05.934349 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:05.935192 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:05.936255 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:05.937515 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:06.167917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:06.180879 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d1f182df-1675-4400-993f-a03b80617036 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1271 microversion: 2.1 time: 0.263150 Sep 08 16:25:06.182057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 459/971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:05 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:25:07.200847 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:07.201452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:07.221025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:07.221482 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:07.222283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:07.222725 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:07.257824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34834. Sep 08 16:25:07.354046 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:07.371000 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-8bfb305e-33d2-4757-8313-66dc2a95191c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1277 microversion: 2.1 time: 0.173515 Sep 08 16:25:07.372415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 513/972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:07 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:25:08.402262 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:08.403437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:08.416925 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:08.417720 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:08.419153 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:08.419972 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:08.690659 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-7b39ab7d-16c8-45e5-83b5-17175b8f89c5 req-20e46c43-2ea1-4964-81df-4cb7cfb6c4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600d20da-244f-4fe5-880f-178664fd724c", "tag": "cfa9ce4a-ab7f-49b2-aee2-5be242ccb02d"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:25:08.694676 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:25:08.694676 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:25:08.705452 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7b39ab7d-16c8-45e5-83b5-17175b8f89c5 req-20e46c43-2ea1-4964-81df-4cb7cfb6c4b8 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:08.705875 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7b39ab7d-16c8-45e5-83b5-17175b8f89c5 req-20e46c43-2ea1-4964-81df-4cb7cfb6c4b8 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:08.724667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-7b39ab7d-16c8-45e5-83b5-17175b8f89c5 req-20e46c43-2ea1-4964-81df-4cb7cfb6c4b8 service nova] Creating event network-changed:cfa9ce4a-ab7f-49b2-aee2-5be242ccb02d for instance 600d20da-244f-4fe5-880f-178664fd724c on hv-cinder-80789 Sep 08 16:25:08.729846 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-7b39ab7d-16c8-45e5-83b5-17175b8f89c5 req-20e46c43-2ea1-4964-81df-4cb7cfb6c4b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048960 Sep 08 16:25:08.730671 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 514/973] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:25:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:25:09.121397 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:09.137621 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f989e69f-8f1e-483e-806f-b09d4243dacf tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1319 microversion: 2.1 time: 0.742658 Sep 08 16:25:09.138587 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 460/974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:08 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:25:10.164338 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:10.165467 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:10.174631 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:10.175228 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:10.176183 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:10.176718 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:10.495742 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:10.504700 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3d42c53e-7915-4a68-bf6d-f942375887f3 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1319 microversion: 2.1 time: 0.344871 Sep 08 16:25:10.505313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 515/975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:10 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:25:11.522039 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:11.522644 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:11.530503 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:11.530954 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:11.531971 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:11.532399 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:11.750297 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:11.759592 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-07bfd5bf-f579-4ae1-adbf-092fd7bcce5f tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1319 microversion: 2.1 time: 0.241367 Sep 08 16:25:11.760177 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 461/976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:11 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:25:12.781824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:12.782887 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:12.799879 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:12.800673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:12.802060 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:12.802754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:13.082219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:13.090683 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-824b3c1b-e30b-4e9e-939e-5e25e3bc3b85 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1319 microversion: 2.1 time: 0.316064 Sep 08 16:25:13.091275 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 516/977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:12 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:25:14.108256 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:14.110216 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:14.118795 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:14.119247 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:14.120055 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:14.120489 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:14.341646 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:14.351340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-88752295-b03f-4654-9c7c-6391d90a83ef tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1319 microversion: 2.1 time: 0.246799 Sep 08 16:25:14.352130 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 462/978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:14 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:25:14.811191 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-e2f2b4a2-b566-4116-8b35-9a67d8a88185 req-f5951a3d-f231-4a36-a086-7136c5708ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600d20da-244f-4fe5-880f-178664fd724c", "name": "network-vif-plugged", "status": "completed", "tag": "cfa9ce4a-ab7f-49b2-aee2-5be242ccb02d"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:25:14.813905 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:25:14.813905 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:25:14.826988 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-e2f2b4a2-b566-4116-8b35-9a67d8a88185 req-f5951a3d-f231-4a36-a086-7136c5708ce4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:14.828384 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-e2f2b4a2-b566-4116-8b35-9a67d8a88185 req-f5951a3d-f231-4a36-a086-7136c5708ce4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:14.862167 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-e2f2b4a2-b566-4116-8b35-9a67d8a88185 req-f5951a3d-f231-4a36-a086-7136c5708ce4 service nova] Creating event network-vif-plugged:cfa9ce4a-ab7f-49b2-aee2-5be242ccb02d for instance 600d20da-244f-4fe5-880f-178664fd724c on hv-cinder-80789 Sep 08 16:25:14.871861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-e2f2b4a2-b566-4116-8b35-9a67d8a88185 req-f5951a3d-f231-4a36-a086-7136c5708ce4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065024 Sep 08 16:25:14.872957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 517/979] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:25:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:25:15.369228 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:15.369936 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:15.378543 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:15.378989 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:15.379819 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:15.380248 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:15.617123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:15.628527 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d2a319bc-3c88-4b01-be7b-224fa8c246c2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1319 microversion: 2.1 time: 0.263141 Sep 08 16:25:15.629215 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 463/980] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:15 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:25:16.646698 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:25:16.647415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:16.655424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:16.656669 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:16.657470 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:16.657924 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:16.879617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:25:16.889458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-02fa98e3-84ad-40ae-a8d1-b9951970a12a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1508 microversion: 2.1 time: 0.246774 Sep 08 16:25:16.890832 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 518/981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:25:16 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:25:34.484948 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3ca352d8-7746-4021-9199-828eb22dd839 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49b456c0-bc81-4d0d-accc-e5ce30ad1fe1", "device": "/dev/sdb"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:25:34.487135 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3ca352d8-7746-4021-9199-828eb22dd839 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:25:34.490764 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: ERROR oslo.messaging._drivers.impl_rabbit [-] [daa093db-1928-42a4-9783-708bc6590c00] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 16:25:34.496844 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ca352d8-7746-4021-9199-828eb22dd839 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:34.497295 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ca352d8-7746-4021-9199-828eb22dd839 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:34.498081 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ca352d8-7746-4021-9199-828eb22dd839 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:25:34.498512 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3ca352d8-7746-4021-9199-828eb22dd839 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:25:35.509625 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] [daa093db-1928-42a4-9783-708bc6590c00] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34960. Sep 08 16:25:35.695257 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3ca352d8-7746-4021-9199-828eb22dd839 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "POST /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215097 Sep 08 16:25:35.695933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 464/982] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:25:34 2021] POST /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:26:01.013037 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:01.013991 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:01.029579 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:01.030476 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:01.032190 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:01.032988 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:01.296813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lazy-loading 'services' on Instance uuid 600d20da-244f-4fe5-880f-178664fd724c {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:26:01.452269 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-92831ad5-e1d2-452e-b130-f2569b93805e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "DELETE /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c/os-volume_attachments/49b456c0-bc81-4d0d-accc-e5ce30ad1fe1" status: 202 len: 0 microversion: 2.1 time: 0.445724 Sep 08 16:26:01.454259 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 519/983] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:26:01 2021] DELETE /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c/os-volume_attachments/49b456c0-bc81-4d0d-accc-e5ce30ad1fe1 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:26:02.688810 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:02.689402 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:02.697455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:02.697827 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:02.698603 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:02.699028 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:02.766522 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:26:02.903598 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6b94a843-b319-4e43-ab30-055091afa5a5 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "DELETE /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 204 len: 0 microversion: 2.1 time: 0.219820 Sep 08 16:26:02.909304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 465/984] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:26:02 2021] DELETE /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:26:02.915896 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:02.917006 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:02.926220 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:02.926666 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:02.927599 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:02.928039 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:03.146145 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:03.154677 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-da0411e3-46b7-4fad-9787-b1ab3486b7df tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1514 microversion: 2.1 time: 0.243648 Sep 08 16:26:03.155295 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 520/985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:02 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:26:04.173780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:04.174478 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:04.182391 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:04.182835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:04.183655 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:04.184084 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:04.430241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:04.440237 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-272797eb-7025-4556-a05d-5852477abd06 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1514 microversion: 2.1 time: 0.271326 Sep 08 16:26:04.440922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 466/986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:04 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:05.459313 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:05.460028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:05.468771 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:05.469323 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:05.470355 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:05.470793 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:05.659429 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:05.669219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-ab084662-240e-4200-9f0e-9bc24ba2fc09 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 200 len: 1472 microversion: 2.1 time: 0.213528 Sep 08 16:26:05.669814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 521/987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:05 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:05.680075 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-943e7a36-9315-41c1-8565-0ce0e72feb79 req-66907fa8-7385-4f9e-8c05-ce704150e7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600d20da-244f-4fe5-880f-178664fd724c", "name": "network-vif-deleted", "tag": "cfa9ce4a-ab7f-49b2-aee2-5be242ccb02d"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:26:05.682808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:26:05.682808 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:26:05.694828 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-943e7a36-9315-41c1-8565-0ce0e72feb79 req-66907fa8-7385-4f9e-8c05-ce704150e7e4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:05.695269 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-943e7a36-9315-41c1-8565-0ce0e72feb79 req-66907fa8-7385-4f9e-8c05-ce704150e7e4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:05.716149 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-943e7a36-9315-41c1-8565-0ce0e72feb79 req-66907fa8-7385-4f9e-8c05-ce704150e7e4 service nova] Creating event network-vif-deleted:cfa9ce4a-ab7f-49b2-aee2-5be242ccb02d for instance 600d20da-244f-4fe5-880f-178664fd724c on hv-cinder-80789 Sep 08 16:26:05.723974 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-943e7a36-9315-41c1-8565-0ce0e72feb79 req-66907fa8-7385-4f9e-8c05-ce704150e7e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047441 Sep 08 16:26:05.724901 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 467/988] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:26:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:26:06.687490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:06.688355 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: 600d20da-244f-4fe5-880f-178664fd724c] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:06.696076 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:06.696540 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:06.697312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:06.697737 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:06.754507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] HTTP exception thrown: Instance 600d20da-244f-4fe5-880f-178664fd724c could not be found. Sep 08 16:26:06.755104 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Returning 404 to user: Instance 600d20da-244f-4fe5-880f-178664fd724c could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:26:06.756277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-93037012-ac4d-4009-a9bc-26812bff01fa tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c" status: 404 len: 111 microversion: 2.1 time: 0.073030 Sep 08 16:26:06.756917 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 522/989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:06 2021] GET /compute/v2.1/servers/600d20da-244f-4fe5-880f-178664fd724c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:26:16.265903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-370962979", "imageRef": "a2679c6f-79ce-4918-aeff-7986f3af65ab", "flavorRef": "452", "networks": [{"uuid": "e4fe72d6-9de9-4d22-bc86-742563af7824"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:26:16.336382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] validate_networks() for [('e4fe72d6-9de9-4d22-bc86-742563af7824', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:26:17.033654 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:26:17.034120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:26:17.034601 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:26:17.035012 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:26:17.035427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:26:17.044740 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:17.045289 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:17.046109 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:17.046581 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:17.065450 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Getting quotas for project e174abb16dc144848c118fcce03c19f8. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:26:17.069527 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Getting quotas for user c447b979ec0c4f919d82694e1a67bc6f and project e174abb16dc144848c118fcce03c19f8. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:26:17.081440 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:26:17.083908 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2679c6f-79ce-4918-aeff-7986f3af65ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:26:17.148741 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9bcd6bf2-9529-4bf7-a849-322a1d45d0eb tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879524 Sep 08 16:26:17.150696 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 468/990] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:26:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:26:17.161509 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-38f063bd-95d8-4b62-854f-c4ee6843557d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:17.162265 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-38f063bd-95d8-4b62-854f-c4ee6843557d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:17.239902 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-38f063bd-95d8-4b62-854f-c4ee6843557d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:17.249255 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-38f063bd-95d8-4b62-854f-c4ee6843557d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1218 microversion: 2.1 time: 0.091687 Sep 08 16:26:17.249839 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 523/991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:17 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:18.279054 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:18.280847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:18.295549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:18.296909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:18.298393 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:18.299200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:18.480581 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:18.499744 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3710229d-4067-41eb-bf73-5bfd647b0d86 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1270 microversion: 2.1 time: 0.227545 Sep 08 16:26:18.500793 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 469/992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:18 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:19.526664 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:19.527757 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:19.544083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:19.544858 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:19.546871 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:19.547702 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:19.766113 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:19.774823 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-7f47f8e9-c926-4352-b475-a23a1c650e6b tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1276 microversion: 2.1 time: 0.255642 Sep 08 16:26:19.775678 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 524/993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:19 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:20.798227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:20.799385 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:20.814161 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:20.814943 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:20.816413 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:20.817188 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:21.314279 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-7e4843d1-d40d-407f-9e5a-c97c65e65f3c req-87465d36-067f-4a89-938a-90e95ca91c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5315aa-7830-4bd9-82df-6ae33d15b03e", "tag": "250c5cb8-df3d-45e9-9c5e-e6c6ff40b273"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:26:21.316178 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:26:21.316178 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:26:21.328972 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7e4843d1-d40d-407f-9e5a-c97c65e65f3c req-87465d36-067f-4a89-938a-90e95ca91c23 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:21.329415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7e4843d1-d40d-407f-9e5a-c97c65e65f3c req-87465d36-067f-4a89-938a-90e95ca91c23 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:21.348710 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-7e4843d1-d40d-407f-9e5a-c97c65e65f3c req-87465d36-067f-4a89-938a-90e95ca91c23 service nova] Creating event network-changed:250c5cb8-df3d-45e9-9c5e-e6c6ff40b273 for instance ba5315aa-7830-4bd9-82df-6ae33d15b03e on hv-cinder-80789 Sep 08 16:26:21.351508 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:21.357160 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-7e4843d1-d40d-407f-9e5a-c97c65e65f3c req-87465d36-067f-4a89-938a-90e95ca91c23 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047089 Sep 08 16:26:21.358667 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 525/994] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:26:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:26:21.364707 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-651243f5-0cdc-463f-88a7-5fb9ce7d06d7 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1318 microversion: 2.1 time: 0.574375 Sep 08 16:26:21.365326 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 470/995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:20 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:22.384298 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:22.385239 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:22.396616 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:22.397055 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:22.397845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:22.398268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:22.770093 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:22.779144 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a5e40b6d-97c6-4cb1-9640-204d970e861e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1318 microversion: 2.1 time: 0.399944 Sep 08 16:26:22.779965 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 526/996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:22 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:23.803953 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:23.805073 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:23.818802 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:23.819632 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:23.820961 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:23.821716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:24.106522 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:24.116864 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a9f3949c-01f0-440d-99db-8c34645f8084 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1318 microversion: 2.1 time: 0.319636 Sep 08 16:26:24.117719 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 471/997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:23 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:25.138782 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:25.140572 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:25.150017 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:25.150693 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:25.151691 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:25.152367 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:25.437142 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:25.449283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-129ec375-3aba-4b21-addb-ebed19260a62 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1318 microversion: 2.1 time: 0.316132 Sep 08 16:26:25.450186 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 527/998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:25 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:26.466205 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:26.466862 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:26.474524 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:26.474972 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:26.475794 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:26.476231 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:26.680053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:26.688775 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-4b2a9f0f-e058-4621-9d80-4b8fff81f788 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1318 microversion: 2.1 time: 0.226374 Sep 08 16:26:26.689337 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 472/999] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:26 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:27.255199 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-f23ea1d1-986b-44df-9568-c7ef022d66c8 req-459625fa-d229-4647-9a72-7e3e4ee1228a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5315aa-7830-4bd9-82df-6ae33d15b03e", "name": "network-vif-plugged", "status": "completed", "tag": "250c5cb8-df3d-45e9-9c5e-e6c6ff40b273"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:26:27.257840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:26:27.257840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:26:27.269197 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-f23ea1d1-986b-44df-9568-c7ef022d66c8 req-459625fa-d229-4647-9a72-7e3e4ee1228a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:27.269831 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-f23ea1d1-986b-44df-9568-c7ef022d66c8 req-459625fa-d229-4647-9a72-7e3e4ee1228a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:27.291215 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-f23ea1d1-986b-44df-9568-c7ef022d66c8 req-459625fa-d229-4647-9a72-7e3e4ee1228a service nova] Creating event network-vif-plugged:250c5cb8-df3d-45e9-9c5e-e6c6ff40b273 for instance ba5315aa-7830-4bd9-82df-6ae33d15b03e on hv-cinder-80789 Sep 08 16:26:27.297325 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-f23ea1d1-986b-44df-9568-c7ef022d66c8 req-459625fa-d229-4647-9a72-7e3e4ee1228a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045875 Sep 08 16:26:27.298866 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 528/1000] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:26:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:26:27.705231 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:27.705837 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:27.713229 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:27.713674 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:27.714451 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:27.714886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:27.928133 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:27.938403 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2660ac68-10ca-4240-900d-740d1e55a71e tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1318 microversion: 2.1 time: 0.236964 Sep 08 16:26:27.938992 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 473/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:27 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:28.957471 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:28.958279 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:28.966380 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:28.967384 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:28.968326 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:28.968735 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:29.191798 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:29.200750 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0bb89916-5364-4e57-b334-d5edd8ea98e1 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1506 microversion: 2.1 time: 0.247396 Sep 08 16:26:29.201774 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 529/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:28 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:29.218740 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6c05e1ab-29a0-4a1b-80ad-8a110d9f0940 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05b7f87c-de76-4918-8e78-1e4b53dde244", "device": "/dev/sdb"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:26:29.219903 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6c05e1ab-29a0-4a1b-80ad-8a110d9f0940 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:29.227815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6c05e1ab-29a0-4a1b-80ad-8a110d9f0940 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:29.228391 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6c05e1ab-29a0-4a1b-80ad-8a110d9f0940 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:29.229568 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6c05e1ab-29a0-4a1b-80ad-8a110d9f0940 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:29.230119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6c05e1ab-29a0-4a1b-80ad-8a110d9f0940 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:29.658115 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6c05e1ab-29a0-4a1b-80ad-8a110d9f0940 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "POST /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444043 Sep 08 16:26:29.658818 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 474/1003] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Sep 8 16:26:29 2021] POST /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:26:49.914426 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:49.914993 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:49.923807 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:49.924337 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:49.925178 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:49.925673 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:50.095118 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.objects.instance [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lazy-loading 'services' on Instance uuid ba5315aa-7830-4bd9-82df-6ae33d15b03e {{(pid=93618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 08 16:26:50.233574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a4c83ea0-0a34-4750-aefe-4ae1e992182c tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e/os-volume_attachments/05b7f87c-de76-4918-8e78-1e4b53dde244" status: 202 len: 0 microversion: 2.1 time: 0.324190 Sep 08 16:26:50.234253 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 530/1004] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Sep 8 16:26:49 2021] DELETE /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e/os-volume_attachments/05b7f87c-de76-4918-8e78-1e4b53dde244 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:26:51.456272 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:51.456896 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:51.465610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:51.466057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:51.467739 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:51.468184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:51.531104 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Going to try to terminate instance {{(pid=93617) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:26:51.654488 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9bedfb44-2ae4-4555-8811-746de6bd8d60 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 204 len: 0 microversion: 2.1 time: 0.206245 Sep 08 16:26:51.655495 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 475/1005] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:26:51 2021] DELETE /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:26:51.664159 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:51.664861 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:51.672933 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:51.673385 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:51.674177 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:51.674613 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:51.999076 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:52.007527 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b8e6cd6c-36fc-4f4d-bfc0-74fd65b8c22a tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1512 microversion: 2.1 time: 0.347418 Sep 08 16:26:52.008104 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 531/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:51 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:26:53.027136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:53.028084 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:53.036058 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:53.036570 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:53.037869 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:53.038676 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:53.256641 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:53.265631 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-d70c667a-2f4b-4488-80a4-282d1148c508 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1512 microversion: 2.1 time: 0.242625 Sep 08 16:26:53.266219 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 476/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:53 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:26:54.282960 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:54.283860 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:54.291182 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:54.291674 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:54.292466 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:54.292906 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:54.389780 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-e9109537-9d69-474b-b23b-095f8cb658ff req-044c30cf-959e-4a94-912c-e6a008e06e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5315aa-7830-4bd9-82df-6ae33d15b03e", "name": "network-vif-deleted", "tag": "250c5cb8-df3d-45e9-9c5e-e6c6ff40b273"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:26:54.392199 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:26:54.392199 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:26:54.403926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-e9109537-9d69-474b-b23b-095f8cb658ff req-044c30cf-959e-4a94-912c-e6a008e06e98 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:54.404367 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-e9109537-9d69-474b-b23b-095f8cb658ff req-044c30cf-959e-4a94-912c-e6a008e06e98 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:54.440107 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-e9109537-9d69-474b-b23b-095f8cb658ff req-044c30cf-959e-4a94-912c-e6a008e06e98 service nova] Creating event network-vif-deleted:250c5cb8-df3d-45e9-9c5e-e6c6ff40b273 for instance ba5315aa-7830-4bd9-82df-6ae33d15b03e on hv-cinder-80789 Sep 08 16:26:54.441801 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c447b979ec0c4f919d82694e1a67bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e174abb16dc144848c118fcce03c19f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:26:54.449741 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-e9109537-9d69-474b-b23b-095f8cb658ff req-044c30cf-959e-4a94-912c-e6a008e06e98 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199907 Sep 08 16:26:54.451334 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 532/1008] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:26:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:26:54.457298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-7b8bfedc-799b-4112-b9d9-0b13eef5ac6d tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 200 len: 1303 microversion: 2.1 time: 0.178269 Sep 08 16:26:54.458221 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 477/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:54 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:26:55.476329 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:26:55.477013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] [instance: ba5315aa-7830-4bd9-82df-6ae33d15b03e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:26:55.485376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:55.485820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:55.486594 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:26:55.487025 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:26:55.540190 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] HTTP exception thrown: Instance ba5315aa-7830-4bd9-82df-6ae33d15b03e could not be found. Sep 08 16:26:55.540789 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] Returning 404 to user: Instance ba5315aa-7830-4bd9-82df-6ae33d15b03e could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:26:55.541615 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c7d22d43-059c-452c-ae54-4dd4e645a5b2 tempest-VolumesSnapshotTestJSON-516044987 tempest-VolumesSnapshotTestJSON-516044987-project] 10.222.0.25 "GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e" status: 404 len: 111 microversion: 2.1 time: 0.069450 Sep 08 16:26:55.542176 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 533/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:26:55 2021] GET /compute/v2.1/servers/ba5315aa-7830-4bd9-82df-6ae33d15b03e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:27:11.889746 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:27:11.890446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:27:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:27:39.084225 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-09754521-0e49-494b-b2f8-2c66318372ab tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Action: 'create', calling method: .version_select at 0x7f3705094dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-77182998"}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:27:39.113971 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-09754521-0e49-494b-b2f8-2c66318372ab tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for project d48dfce1083d414da5ba06085d3813d3. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:27:39.118716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-09754521-0e49-494b-b2f8-2c66318372ab tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for user a052e4aeda6d4a9ba527d49ba434d837 and project d48dfce1083d414da5ba06085d3813d3. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:27:39.232725 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-09754521-0e49-494b-b2f8-2c66318372ab tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for project d48dfce1083d414da5ba06085d3813d3. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:27:39.237136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-09754521-0e49-494b-b2f8-2c66318372ab tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for user a052e4aeda6d4a9ba527d49ba434d837 and project d48dfce1083d414da5ba06085d3813d3. Resources: {'key_pairs'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:27:39.252736 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-09754521-0e49-494b-b2f8-2c66318372ab tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.397840 Sep 08 16:27:39.253340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 478/1011] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Sep 8 16:27:38 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:27:40.355888 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:27:40.357375 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:27:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:27:58.510596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-584483665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-77182998", "security_groups": [{"name": "tempest-secgroup-smoke-241192911"}], "block_device_mapping_v2": [{"uuid": "8d4cc604-6897-480f-965a-f3266fc7e452", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "69526384-0cc0-4c99-a503-762a8eb23837"}]}} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:27:58.716804 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.network.neutron [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] validate_networks() for [('69526384-0cc0-4c99-a503-762a8eb23837', None, None, None)] {{(pid=93618) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:27:59.571853 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Flavor limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:27:59.572835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Image limits 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:27:59.573219 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Flavor pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:27:59.573744 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Image pref 0:0:0 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:27:59.574250 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.virt.hardware [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:27:59.583845 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:27:59.584341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:27:59.585209 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:27:59.585765 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:27:59.605746 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for project d48dfce1083d414da5ba06085d3813d3. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:27:59.610493 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.quota [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for user a052e4aeda6d4a9ba527d49ba434d837 and project d48dfce1083d414da5ba06085d3813d3. Resources: {'instances', 'ram', 'cores'} {{(pid=93618) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:27:59.720963 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Going to run 1 instances... {{(pid=93618) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:27:59.723291 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d4cc604-6897-480f-965a-f3266fc7e452',volume_size=None,volume_type=None)] {{(pid=93618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:27:59.984768 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5b8b75aa-9a96-47a4-a917-15dde07862b4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.477678 Sep 08 16:27:59.985917 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 534/1012] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:27:58 2021] POST /compute/v2.1/servers => generated 405 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:28:00.002256 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-e5b7f5b7-586c-4da5-b540-dedc8cd8551d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:00.003198 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-e5b7f5b7-586c-4da5-b540-dedc8cd8551d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:00.096933 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-e5b7f5b7-586c-4da5-b540-dedc8cd8551d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:00.107878 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-e5b7f5b7-586c-4da5-b540-dedc8cd8551d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1092 microversion: 2.1 time: 0.111792 Sep 08 16:28:00.108485 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 479/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:27:59 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1092 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:28:01.133996 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:01.134733 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:01.144374 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:01.144819 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:01.145617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:01.146053 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:01.419536 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:01.429850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f05ab10c-39a7-4dda-9a3e-d5866b98d487 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1198 microversion: 2.1 time: 0.300819 Sep 08 16:28:01.430733 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 535/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:01 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1198 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:02.458498 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:02.459610 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:02.472232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:02.473447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:02.475144 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:02.476104 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:02.982729 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:02.991662 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-492bc3a8-ec41-4f8e-9488-08023b33283d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.538679 Sep 08 16:28:02.992263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 480/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:02 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:28:03.875441 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-7d76eed9-0ce5-4be1-9fdb-d6e6e137ec34 req-15bd97b4-96b8-414e-9ea7-6afa54e95813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a3ee99-83f9-4271-84e8-d09119947db2", "tag": "c0b0c74d-0643-4b98-b4ed-6e68a631f4c6"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:28:03.885865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:28:03.885865 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:28:03.905159 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7d76eed9-0ce5-4be1-9fdb-d6e6e137ec34 req-15bd97b4-96b8-414e-9ea7-6afa54e95813 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:03.905965 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-7d76eed9-0ce5-4be1-9fdb-d6e6e137ec34 req-15bd97b4-96b8-414e-9ea7-6afa54e95813 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:03.943103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-7d76eed9-0ce5-4be1-9fdb-d6e6e137ec34 req-15bd97b4-96b8-414e-9ea7-6afa54e95813 service nova] Creating event network-changed:c0b0c74d-0643-4b98-b4ed-6e68a631f4c6 for instance 98a3ee99-83f9-4271-84e8-d09119947db2 on hv-cinder-80789 Sep 08 16:28:03.953038 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-7d76eed9-0ce5-4be1-9fdb-d6e6e137ec34 req-15bd97b4-96b8-414e-9ea7-6afa54e95813 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088897 Sep 08 16:28:03.954043 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 536/1016] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:28:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:28:04.011032 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:04.012549 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:04.020364 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:04.020814 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:04.021604 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:04.022045 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:04.402006 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:04.411952 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-595a0d2c-ed09-4a04-bfe1-f2d5472e3a71 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.405011 Sep 08 16:28:04.412546 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 481/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:04 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:05.432958 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:05.434344 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:05.442190 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:05.442648 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:05.443448 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:05.443911 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:05.831057 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:05.846445 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-735c8eb9-b772-4bb5-9905-8dcca7d5a4ff tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.417224 Sep 08 16:28:05.847537 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 537/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:05 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:06.873109 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:06.874128 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:06.882591 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:06.883026 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:06.883832 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:06.884263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:07.098702 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:07.107852 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-32d38d88-db23-406c-aa7f-0e33b09158e2 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.239888 Sep 08 16:28:07.108441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 482/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:06 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:28:08.125523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:08.126157 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:08.129773 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 16:28:08.135395 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:08.135903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:08.136752 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:08.137257 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:08.369763 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:08.386330 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1c9014f1-d7ea-45f4-a5db-27503bf9805d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.264338 Sep 08 16:28:08.387242 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 538/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:08 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:28:09.404990 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:09.405698 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:09.413683 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:09.414126 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:09.414917 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:09.415355 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:09.637111 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:09.648203 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-f772233d-7805-48bb-ae3b-2119cc655352 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.247980 Sep 08 16:28:09.649089 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 483/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:09 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:10.666183 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:10.666816 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:10.686058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:10.686501 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:10.687281 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:10.687752 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:10.722230 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35640. Sep 08 16:28:10.911056 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:10.927652 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-71c88e2f-cb4a-42f2-a06b-fabd407f4b43 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.264584 Sep 08 16:28:10.928629 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 539/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:10 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:11.954372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:11.954968 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:11.962529 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:11.962982 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:11.963836 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:11.964274 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:12.170325 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:12.178666 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-37a835b7-7bd1-4a97-bbc5-16f526594880 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.229205 Sep 08 16:28:12.179241 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 484/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:11 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:13.197312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:13.197913 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:13.206414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:13.206923 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:13.207820 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:13.208306 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:13.437824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:13.447078 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-18ca6c13-dae1-47db-89c1-c9126f29277b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.253551 Sep 08 16:28:13.447835 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 540/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:13 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:14.464188 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:14.465441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:14.473700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:14.474156 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:14.474952 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:14.475389 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:14.680924 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:14.689811 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3006e59b-a195-4d21-b4e5-937ec3ee163a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.229338 Sep 08 16:28:14.690377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 485/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:14 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:15.706680 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:15.707611 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:15.720726 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:15.721463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:15.722787 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:15.723630 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:15.950643 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:15.959875 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-53b48cb0-04ff-4f48-929c-84d47fe2b04d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.256686 Sep 08 16:28:15.960377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 541/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:15 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:16.091441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-3eb3f9e8-4e92-4a64-9ac0-df7339cd1dae req-e525c4af-c09e-48da-9368-b494899653b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a3ee99-83f9-4271-84e8-d09119947db2", "name": "network-vif-plugged", "status": "completed", "tag": "c0b0c74d-0643-4b98-b4ed-6e68a631f4c6"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:28:16.093014 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:28:16.093014 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:28:16.101377 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-3eb3f9e8-4e92-4a64-9ac0-df7339cd1dae req-e525c4af-c09e-48da-9368-b494899653b4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:16.101812 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-3eb3f9e8-4e92-4a64-9ac0-df7339cd1dae req-e525c4af-c09e-48da-9368-b494899653b4 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:16.119263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-3eb3f9e8-4e92-4a64-9ac0-df7339cd1dae req-e525c4af-c09e-48da-9368-b494899653b4 service nova] Creating event network-vif-plugged:c0b0c74d-0643-4b98-b4ed-6e68a631f4c6 for instance 98a3ee99-83f9-4271-84e8-d09119947db2 on hv-cinder-80789 Sep 08 16:28:16.125188 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-3eb3f9e8-4e92-4a64-9ac0-df7339cd1dae req-e525c4af-c09e-48da-9368-b494899653b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143822 Sep 08 16:28:16.125835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 486/1027] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:28:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:28:16.979339 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:16.980052 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:16.987785 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:16.988202 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:16.988974 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:16.989402 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:17.210895 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:17.220495 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e674a661-9f91-4948-a862-bc65fbd034d7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1263 microversion: 2.1 time: 0.244912 Sep 08 16:28:17.221090 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 542/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:16 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1263 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:18.238042 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:18.238736 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:18.247016 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:18.247462 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:18.248296 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:18.248730 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:18.463748 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:18.473797 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-34d4137c-d3e7-49c7-beb1-2a83925f06cb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1450 microversion: 2.1 time: 0.240082 Sep 08 16:28:18.474381 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 487/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:18 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1450 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:18.490474 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:28:18.491059 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:28:18.499532 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:18.499995 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:18.500789 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:18.501241 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:18.739658 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:28:18.749784 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-5919b99d-a35a-46b5-ab85-bb2fd44b1281 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1450 microversion: 2.1 time: 0.262929 Sep 08 16:28:18.750296 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 543/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:28:18 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1450 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:28:21.946163 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-f0813c54-f886-4df2-b5af-1609ceb53b4e req-58296236-3736-43b7-8a65-5d6e895ee8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a3ee99-83f9-4271-84e8-d09119947db2", "tag": "c0b0c74d-0643-4b98-b4ed-6e68a631f4c6"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:28:21.950525 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:28:21.950525 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:28:21.967097 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f0813c54-f886-4df2-b5af-1609ceb53b4e req-58296236-3736-43b7-8a65-5d6e895ee8dc service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:28:21.967978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-f0813c54-f886-4df2-b5af-1609ceb53b4e req-58296236-3736-43b7-8a65-5d6e895ee8dc service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:28:21.995860 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-f0813c54-f886-4df2-b5af-1609ceb53b4e req-58296236-3736-43b7-8a65-5d6e895ee8dc service nova] Creating event network-changed:c0b0c74d-0643-4b98-b4ed-6e68a631f4c6 for instance 98a3ee99-83f9-4271-84e8-d09119947db2 on hv-cinder-80789 Sep 08 16:28:22.000459 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-f0813c54-f886-4df2-b5af-1609ceb53b4e req-58296236-3736-43b7-8a65-5d6e895ee8dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063129 Sep 08 16:28:22.001064 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 488/1031] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:28:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:28:52.188177 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:28:52.188986 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:28:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:30:16.717109 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:16.717838 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:16.725628 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:16.726074 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:16.726869 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:16.727311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:16.795813 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:30:16.938421 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-85956903-049c-4589-82db-0eca0187217b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 204 len: 0 microversion: 2.1 time: 0.223300 Sep 08 16:30:16.940191 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 544/1032] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:30:16 2021] DELETE /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:30:16.951859 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: ERROR oslo.messaging._drivers.impl_rabbit [-] [daa093db-1928-42a4-9783-708bc6590c00] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 16:30:16.959079 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:16.960365 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:16.975879 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:16.976593 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:16.978675 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:16.979513 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:17.359541 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:17.368536 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-47a33a6d-7042-4b39-b81e-00e6f44ada1b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1574 microversion: 2.1 time: 0.422067 Sep 08 16:30:17.369439 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 489/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:16 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1574 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:18.397043 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:18.397725 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:18.406531 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:18.407028 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:18.407907 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:18.408378 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:18.625860 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:18.636277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e131df9b-f9dd-4035-b64f-0fe3b54aeb66 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1574 microversion: 2.1 time: 0.243236 Sep 08 16:30:18.637020 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 545/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:18 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:19.658831 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:19.659962 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:19.690063 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:19.690749 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:19.692040 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:19.692761 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:19.805838 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] [daa093db-1928-42a4-9783-708bc6590c00] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35708. Sep 08 16:30:19.902475 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:19.918871 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-96312396-df0c-456f-93a3-3b6581fb0234 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1507 microversion: 2.1 time: 0.266056 Sep 08 16:30:19.920209 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 490/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:19 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:20.435679 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-6d0087ab-8212-4728-8fe3-79198864c051 req-e3c85a2a-c12e-4f44-afd2-24f9fa2fa709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a3ee99-83f9-4271-84e8-d09119947db2", "name": "network-vif-deleted", "tag": "c0b0c74d-0643-4b98-b4ed-6e68a631f4c6"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:30:20.438549 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:30:20.438549 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:30:20.456520 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-6d0087ab-8212-4728-8fe3-79198864c051 req-e3c85a2a-c12e-4f44-afd2-24f9fa2fa709 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:20.457229 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-6d0087ab-8212-4728-8fe3-79198864c051 req-e3c85a2a-c12e-4f44-afd2-24f9fa2fa709 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:20.482752 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-6d0087ab-8212-4728-8fe3-79198864c051 req-e3c85a2a-c12e-4f44-afd2-24f9fa2fa709 service nova] Creating event network-vif-deleted:c0b0c74d-0643-4b98-b4ed-6e68a631f4c6 for instance 98a3ee99-83f9-4271-84e8-d09119947db2 on hv-cinder-80789 Sep 08 16:30:20.491458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-6d0087ab-8212-4728-8fe3-79198864c051 req-e3c85a2a-c12e-4f44-afd2-24f9fa2fa709 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063198 Sep 08 16:30:20.492364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 546/1036] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:30:20.949153 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:20.950285 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:20.965753 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:20.966537 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:20.967922 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:20.968726 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:21.231183 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:21.241374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-83c24da7-b3c8-4bd2-8ed4-58eaa1169b27 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 200 len: 1223 microversion: 2.1 time: 0.300913 Sep 08 16:30:21.242147 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 491/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:20 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 1223 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:22.267492 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:22.268352 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:22.277593 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:22.278918 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:22.278918 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:22.279268 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:22.334020 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] HTTP exception thrown: Instance 98a3ee99-83f9-4271-84e8-d09119947db2 could not be found. Sep 08 16:30:22.334630 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Returning 404 to user: Instance 98a3ee99-83f9-4271-84e8-d09119947db2 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:30:22.335512 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-01f9ca2f-10ce-48a2-bdb3-3f9ce00cf755 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 404 len: 111 microversion: 2.1 time: 0.072837 Sep 08 16:30:22.336111 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 547/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:22 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:30:22.394123 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1204163673", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-77182998", "security_groups": [{"name": "tempest-secgroup-smoke-241192911"}], "block_device_mapping_v2": [{"uuid": "8d4cc604-6897-480f-965a-f3266fc7e452", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "69526384-0cc0-4c99-a503-762a8eb23837"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:30:22.575255 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] validate_networks() for [('69526384-0cc0-4c99-a503-762a8eb23837', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:30:23.263286 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:30:23.263780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:30:23.264303 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:30:23.264758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:30:23.265219 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:30:23.275125 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:23.275606 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:23.276437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:23.276872 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:23.297861 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for project d48dfce1083d414da5ba06085d3813d3. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:30:23.302651 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for user a052e4aeda6d4a9ba527d49ba434d837 and project d48dfce1083d414da5ba06085d3813d3. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:30:23.419867 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:30:23.422086 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d4cc604-6897-480f-965a-f3266fc7e452',volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:30:23.692235 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-6ca86244-1ed5-49ad-95f0-835cbab3b443 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.301381 Sep 08 16:30:23.693283 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 492/1039] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:30:22 2021] POST /compute/v2.1/servers => generated 405 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:30:23.705736 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-449e8fb6-e837-4935-83a1-9e7a9fd2052f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:23.707076 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-449e8fb6-e837-4935-83a1-9e7a9fd2052f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:23.792576 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-449e8fb6-e837-4935-83a1-9e7a9fd2052f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:23.800600 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-449e8fb6-e837-4935-83a1-9e7a9fd2052f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1093 microversion: 2.1 time: 0.099035 Sep 08 16:30:23.801175 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 548/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:23 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:24.818905 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-01467bd2-5654-46b6-ab07-40f3bbb0a596 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:24.819551 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-01467bd2-5654-46b6-ab07-40f3bbb0a596 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:24.897716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-01467bd2-5654-46b6-ab07-40f3bbb0a596 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:24.912089 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-01467bd2-5654-46b6-ab07-40f3bbb0a596 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1093 microversion: 2.1 time: 0.096599 Sep 08 16:30:24.913125 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 493/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:24 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1093 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:25.937013 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-92a27c66-d362-46ed-8973-98e2414f77ba tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:25.938662 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-92a27c66-d362-46ed-8973-98e2414f77ba tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:26.050934 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-92a27c66-d362-46ed-8973-98e2414f77ba tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:26.060803 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-92a27c66-d362-46ed-8973-98e2414f77ba tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1093 microversion: 2.1 time: 0.131053 Sep 08 16:30:26.061571 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 549/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:25 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1093 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:27.079771 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fa8e9383-28ae-4d1c-9ad0-6498dff6126b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:27.080628 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fa8e9383-28ae-4d1c-9ad0-6498dff6126b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:27.170719 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fa8e9383-28ae-4d1c-9ad0-6498dff6126b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:27.182886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fa8e9383-28ae-4d1c-9ad0-6498dff6126b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1093 microversion: 2.1 time: 0.106333 Sep 08 16:30:27.183386 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 494/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:27 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1093 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:28.209242 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:28.209814 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:28.218320 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:28.218777 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:28.219701 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:28.220045 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:28.348815 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:28.360095 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-617399b4-f502-4311-b476-aa64eb166c63 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1143 microversion: 2.1 time: 0.154603 Sep 08 16:30:28.361024 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 550/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:28 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1143 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:29.378898 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:29.379835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:29.390000 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:29.391082 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:29.392842 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:29.393614 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:29.561455 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:29.578082 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2429863a-733b-45e6-a7b4-90a693ac3042 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1209 microversion: 2.1 time: 0.202448 Sep 08 16:30:29.579098 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 495/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:29 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1209 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:30.613098 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:30.614505 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:30.632134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:30.632957 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:30.634596 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:30.636789 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:31.171061 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:31.181580 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-064b0836-fba3-4c98-bc9e-3b8a13cbbb48 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.578599 Sep 08 16:30:31.182442 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 551/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:30 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:31.911087 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:30:31.912117 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-04bc274c-c197-4f94-accd-a30c00c806c9 req-6c74edea-edf8-41c0-8642-21ff9a382d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeaf9531-64bb-417e-b012-6c266e39f8c2", "tag": "91d8ec70-f575-46bb-9d90-c08e8ef8bd3e"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:30:31.913541 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:30:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:30:31.915077 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:30:31.915077 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:30:31.931548 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-04bc274c-c197-4f94-accd-a30c00c806c9 req-6c74edea-edf8-41c0-8642-21ff9a382d8a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:31.932636 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-04bc274c-c197-4f94-accd-a30c00c806c9 req-6c74edea-edf8-41c0-8642-21ff9a382d8a service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:31.962431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-04bc274c-c197-4f94-accd-a30c00c806c9 req-6c74edea-edf8-41c0-8642-21ff9a382d8a service nova] Creating event network-changed:91d8ec70-f575-46bb-9d90-c08e8ef8bd3e for instance aeaf9531-64bb-417e-b012-6c266e39f8c2 on hv-cinder-80789 Sep 08 16:30:31.969558 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-04bc274c-c197-4f94-accd-a30c00c806c9 req-6c74edea-edf8-41c0-8642-21ff9a382d8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065185 Sep 08 16:30:31.972884 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 496/1047] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:30:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:30:32.203756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:32.203756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:32.209850 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:32.210504 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:32.211302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:32.212995 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:32.720228 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:32.731908 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a804fede-3170-4507-9ff7-79ed4d3e1411 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.535438 Sep 08 16:30:32.732857 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 552/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:32 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:33.759106 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:33.760110 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:33.767993 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:33.768437 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:33.769210 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:33.769640 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:34.001290 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:34.010309 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-55b047f0-0929-413e-90f4-cc9fd37adda7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.255806 Sep 08 16:30:34.011005 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 497/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:33 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:35.029356 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:35.030361 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:35.038383 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:35.039103 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:35.040712 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:35.041222 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:35.260165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:35.269691 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-dcf1c50c-7fe8-4444-9958-1192dd625c8f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.245262 Sep 08 16:30:35.270353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 553/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:35 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:36.294386 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:36.295046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:36.302612 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:36.303046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:36.303846 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:36.304271 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:36.591969 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:36.601200 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2111fffd-1e4c-4cb7-a34d-c228cd8d17e4 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.310505 Sep 08 16:30:36.601863 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 498/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:36 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:37.619661 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:37.620561 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:37.628797 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:37.629237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:37.630020 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:37.630447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:37.852083 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:37.861252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-332bd98e-f5e3-4853-a8ac-ddde2d485f0b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.246624 Sep 08 16:30:37.861847 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 554/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:37 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:38.889048 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:38.890185 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:38.904978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:38.905775 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:38.907184 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:38.908016 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:39.175443 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:39.192155 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-be74e353-8fb1-46ed-9024-535f1524dfcb tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.310009 Sep 08 16:30:39.193175 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 499/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:38 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:40.210426 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:40.211068 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:40.219507 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:40.219964 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:40.220753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:40.221188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:40.435756 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:40.444521 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-0b125ec8-82e0-41a6-bb91-418123dc863c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.237998 Sep 08 16:30:40.445165 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 555/1054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:40 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:41.463691 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:41.464569 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:41.472499 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:41.472938 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:41.473731 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:41.474158 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:41.753480 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:41.762543 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-fc120ca7-014b-41b7-848b-7acb94e0dd56 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.303736 Sep 08 16:30:41.763199 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 500/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:41 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:42.784341 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:42.785463 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:42.800627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:42.801424 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:42.802822 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:42.803637 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:42.845081 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-53a8f9c1-d33b-40e0-bd08-ce49cdd6707a req-bcaf18b5-46f2-400d-906a-852eeab25a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeaf9531-64bb-417e-b012-6c266e39f8c2", "name": "network-vif-plugged", "status": "completed", "tag": "91d8ec70-f575-46bb-9d90-c08e8ef8bd3e"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:30:42.847120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:30:42.847120 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:30:42.863053 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-53a8f9c1-d33b-40e0-bd08-ce49cdd6707a req-bcaf18b5-46f2-400d-906a-852eeab25a20 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:42.863941 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-53a8f9c1-d33b-40e0-bd08-ce49cdd6707a req-bcaf18b5-46f2-400d-906a-852eeab25a20 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:42.899845 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-53a8f9c1-d33b-40e0-bd08-ce49cdd6707a req-bcaf18b5-46f2-400d-906a-852eeab25a20 service nova] Creating event network-vif-plugged:91d8ec70-f575-46bb-9d90-c08e8ef8bd3e for instance aeaf9531-64bb-417e-b012-6c266e39f8c2 on hv-cinder-80789 Sep 08 16:30:42.910971 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-53a8f9c1-d33b-40e0-bd08-ce49cdd6707a req-bcaf18b5-46f2-400d-906a-852eeab25a20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070049 Sep 08 16:30:42.912270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 501/1056] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:30:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:30:43.066951 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:43.084518 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-535f39fd-f6a4-47da-a98b-5bae2ba1274b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.306124 Sep 08 16:30:43.085465 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 556/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:42 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:44.111663 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:44.112567 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:44.121087 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:44.121528 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:44.122331 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:44.122763 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:44.353574 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:44.362984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-a7e16b46-27af-4c84-8033-bca1827facd6 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1264 microversion: 2.1 time: 0.255546 Sep 08 16:30:44.365155 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 502/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:44 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1264 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:45.381081 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:45.381719 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:45.389585 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:45.390032 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:45.390828 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:45.391261 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:45.597627 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:45.607359 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-c787a3ce-ab9f-4992-be37-44dcfd28e49f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1451 microversion: 2.1 time: 0.229986 Sep 08 16:30:45.608322 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 557/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:45 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:30:45.635232 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:30:45.635887 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:30:45.646181 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:45.646983 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:45.648484 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:45.649274 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:45.952550 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:30:45.967263 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-45562b15-ec20-411c-8738-4696a48c85e0 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1451 microversion: 2.1 time: 0.336770 Sep 08 16:30:45.968291 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 503/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:30:45 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1451 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:30:48.888443 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-4a56c144-f2b2-4e01-8e76-e75e144fd235 req-2c986639-2601-4dd9-bac6-c3973d12d2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeaf9531-64bb-417e-b012-6c266e39f8c2", "tag": "91d8ec70-f575-46bb-9d90-c08e8ef8bd3e"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:30:48.890730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:30:48.890730 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:30:48.900926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-4a56c144-f2b2-4e01-8e76-e75e144fd235 req-2c986639-2601-4dd9-bac6-c3973d12d2c5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:30:48.901458 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-4a56c144-f2b2-4e01-8e76-e75e144fd235 req-2c986639-2601-4dd9-bac6-c3973d12d2c5 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:30:48.923041 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-4a56c144-f2b2-4e01-8e76-e75e144fd235 req-2c986639-2601-4dd9-bac6-c3973d12d2c5 service nova] Creating event network-changed:91d8ec70-f575-46bb-9d90-c08e8ef8bd3e for instance aeaf9531-64bb-417e-b012-6c266e39f8c2 on hv-cinder-80789 Sep 08 16:30:48.928754 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-4a56c144-f2b2-4e01-8e76-e75e144fd235 req-2c986639-2601-4dd9-bac6-c3973d12d2c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114914 Sep 08 16:30:48.929729 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 558/1061] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:30:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:30:59.041304 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:30:59.041982 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:30:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:31:00.391698 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:31:00.392311 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:31:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:32:19.019352 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1937748769", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-77182998", "security_groups": [{"name": "tempest-secgroup-smoke-241192911"}], "block_device_mapping_v2": [{"uuid": "71bad3b1-1036-4c57-835a-689dad2bac3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "69526384-0cc0-4c99-a503-762a8eb23837"}]}} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:32:19.200150 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.network.neutron [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] validate_networks() for [('69526384-0cc0-4c99-a503-762a8eb23837', None, None, None)] {{(pid=93617) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Sep 08 16:32:19.897764 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Flavor limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:32:19.898494 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Image limits 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:32:19.899408 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Flavor pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:32:19.900240 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Image pref 0:0:0 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:32:19.900994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.virt.hardware [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=93617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:32:19.917136 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:19.917912 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:19.919609 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:19.920382 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:19.955847 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for project d48dfce1083d414da5ba06085d3813d3. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 08 16:32:19.965030 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.quota [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Getting quotas for user a052e4aeda6d4a9ba527d49ba434d837 and project d48dfce1083d414da5ba06085d3813d3. Resources: {'instances', 'ram', 'cores'} {{(pid=93617) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 08 16:32:20.097978 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Going to run 1 instances... {{(pid=93617) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Sep 08 16:32:20.100739 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71bad3b1-1036-4c57-835a-689dad2bac3c',volume_size=None,volume_type=None)] {{(pid=93617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Sep 08 16:32:20.298716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-eafb5201-6721-4def-ab46-1128a154400f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.283039 Sep 08 16:32:20.299370 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 504/1062] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Sep 8 16:32:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:32:20.312772 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 16:32:20.316770 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-40b5b7bd-8cef-4348-9825-c6af8b1ed14d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:20.317481 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-40b5b7bd-8cef-4348-9825-c6af8b1ed14d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:20.451289 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-40b5b7bd-8cef-4348-9825-c6af8b1ed14d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:20.460988 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-40b5b7bd-8cef-4348-9825-c6af8b1ed14d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1093 microversion: 2.1 time: 0.149878 Sep 08 16:32:20.461574 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 559/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:20 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1093 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:21.491548 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:21.492622 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:21.507787 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:21.508578 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:21.509926 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:21.510658 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:21.676833 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:21.688759 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-44f0c9ae-7989-46d0-b35e-f9f44f8f392d tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1191 microversion: 2.1 time: 0.204328 Sep 08 16:32:21.689558 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 505/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:21 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1191 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:22.720415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:22.721235 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:22.730948 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:22.731409 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:22.732464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:22.732881 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:22.794840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] [10eb119f-3f28-42d6-bc5e-3bb3cd01306c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35894. Sep 08 16:32:22.904364 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:22.930562 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-e1c9c474-4a1e-4dc5-b3db-e60a4fde236c tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1209 microversion: 2.1 time: 0.224465 Sep 08 16:32:22.932855 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 560/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:22 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1209 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:32:23.960997 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:23.962434 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:23.972335 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:23.973182 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:23.974350 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:23.975886 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:24.520820 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:24.534539 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-3a240644-0e52-4aed-b84d-21acb3cf40e1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.577642 Sep 08 16:32:24.535420 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 506/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:23 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:32:24.736416 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [req-2df9646e-5eda-467c-9d3a-7c008cb2645b req-cc577b9a-b003-4eb9-8c61-1ae04cfac384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2385f6eb-986f-4af3-84bd-a3df24c4aa3e", "tag": "fcb1af23-6be7-4f45-902c-9a55dd3796a8"}]} {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:32:24.738622 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:32:24.738622 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: warnings.warn(msg) Sep 08 16:32:24.748903 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-2df9646e-5eda-467c-9d3a-7c008cb2645b req-cc577b9a-b003-4eb9-8c61-1ae04cfac384 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:24.760567 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [req-2df9646e-5eda-467c-9d3a-7c008cb2645b req-cc577b9a-b003-4eb9-8c61-1ae04cfac384 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:24.781348 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.compute.server_external_events [req-2df9646e-5eda-467c-9d3a-7c008cb2645b req-cc577b9a-b003-4eb9-8c61-1ae04cfac384 service nova] Creating event network-changed:fcb1af23-6be7-4f45-902c-9a55dd3796a8 for instance 2385f6eb-986f-4af3-84bd-a3df24c4aa3e on hv-cinder-80789 Sep 08 16:32:24.787650 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [req-2df9646e-5eda-467c-9d3a-7c008cb2645b req-cc577b9a-b003-4eb9-8c61-1ae04cfac384 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159013 Sep 08 16:32:24.788591 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 561/1067] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:32:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:32:25.555652 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:25.556639 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:25.564994 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:25.569227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:25.569227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:25.569227 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:26.058122 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:26.068124 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-77c2b589-eb31-430f-838f-a0e81dacc264 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.517521 Sep 08 16:32:26.079037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 507/1068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:25 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:32:27.087898 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:27.088680 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:27.097090 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:27.097593 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:27.098415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:27.098885 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:27.319464 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:27.335875 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-92cdfffa-e574-4c27-9850-3605b59ab220 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.252282 Sep 08 16:32:27.336907 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 562/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:27 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:28.361529 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:28.362267 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:28.371037 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:28.371605 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:28.372402 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:28.372873 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:28.598479 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:28.608021 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-1e90104c-4382-4f2d-9f0e-6fe782aff520 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.250081 Sep 08 16:32:28.608681 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 508/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:28 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:29.626506 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:29.627181 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:29.635969 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:29.636414 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:29.637198 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:29.637632 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:30.113394 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:30.125616 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-75f23dde-7c8f-42c6-866d-4675e1b1d50f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.502449 Sep 08 16:32:30.126724 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 563/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:29 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:31.149100 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:31.150223 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:31.163523 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:31.164320 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:31.165758 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:31.166543 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:31.411069 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:31.420996 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-96e8ee27-1979-4183-aa9e-fab6160ffad7 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.278332 Sep 08 16:32:31.421666 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 509/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:31 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:32.439606 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:32.440349 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:32.448570 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:32.449022 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:32.449818 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:32.450252 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:32.710611 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:32.719152 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-166e9a87-00d6-4a7c-89ce-bf544fd5907f tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.283308 Sep 08 16:32:32.719753 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 564/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:32 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:33.737217 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:33.738817 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:33.748780 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:33.749626 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:33.750589 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:33.751279 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:33.988127 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:33.998385 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-2297a7a9-00f9-4129-8e05-3da605d1278e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.265125 Sep 08 16:32:33.998984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 510/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:33 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:35.016529 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:35.017302 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:35.025437 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:35.025922 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:35.026718 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:35.027154 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:35.238292 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:35.248692 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-718257c3-7ad0-4b02-982f-171e3398cddd tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.235866 Sep 08 16:32:35.249395 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 565/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:35 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:35.556340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-e768365c-071e-433e-b4d6-4c5d56a235b4 req-e4098632-5b80-4ebc-bc71-e96ae9c6663c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2385f6eb-986f-4af3-84bd-a3df24c4aa3e", "name": "network-vif-plugged", "status": "completed", "tag": "fcb1af23-6be7-4f45-902c-9a55dd3796a8"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:32:35.558835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:32:35.558835 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:32:35.574571 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-e768365c-071e-433e-b4d6-4c5d56a235b4 req-e4098632-5b80-4ebc-bc71-e96ae9c6663c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:35.575355 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-e768365c-071e-433e-b4d6-4c5d56a235b4 req-e4098632-5b80-4ebc-bc71-e96ae9c6663c service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:35.609311 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-e768365c-071e-433e-b4d6-4c5d56a235b4 req-e4098632-5b80-4ebc-bc71-e96ae9c6663c service nova] Creating event network-vif-plugged:fcb1af23-6be7-4f45-902c-9a55dd3796a8 for instance 2385f6eb-986f-4af3-84bd-a3df24c4aa3e on hv-cinder-80789 Sep 08 16:32:35.618427 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-e768365c-071e-433e-b4d6-4c5d56a235b4 req-e4098632-5b80-4ebc-bc71-e96ae9c6663c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068572 Sep 08 16:32:35.619585 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 511/1076] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:32:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:32:36.267353 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:36.268200 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:36.279148 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:36.280022 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:36.281513 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:36.282372 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:36.545781 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:36.562334 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-80a98fe5-9c68-48a5-abe2-4780518dd7be tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1264 microversion: 2.1 time: 0.298707 Sep 08 16:32:36.563077 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 566/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:36 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1264 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:37.584169 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:37.584966 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:37.592909 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:37.593356 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:37.594170 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:37.594606 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:37.816700 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:37.827305 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-c5bfd96a-af5a-4abf-968b-dd9573475033 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1451 microversion: 2.1 time: 0.247448 Sep 08 16:32:37.827935 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 512/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:37 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1451 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:37.844975 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:32:37.845831 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:32:37.854982 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:37.855427 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:37.856269 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:37.856702 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:38.099107 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:32:38.109272 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-222f43b6-7471-4d9a-bbf8-3df914c81318 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1451 microversion: 2.1 time: 0.268095 Sep 08 16:32:38.109868 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 567/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:32:37 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1451 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:32:40.993340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-d0ac77ab-b795-4423-9c4c-f9722df0f455 req-9cafdd4e-05fa-42e8-915a-1b640c108d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2385f6eb-986f-4af3-84bd-a3df24c4aa3e", "tag": "fcb1af23-6be7-4f45-902c-9a55dd3796a8"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:32:40.993340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:32:40.993340 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:32:41.002177 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-d0ac77ab-b795-4423-9c4c-f9722df0f455 req-9cafdd4e-05fa-42e8-915a-1b640c108d44 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:32:41.002674 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-d0ac77ab-b795-4423-9c4c-f9722df0f455 req-9cafdd4e-05fa-42e8-915a-1b640c108d44 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:32:41.025782 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-d0ac77ab-b795-4423-9c4c-f9722df0f455 req-9cafdd4e-05fa-42e8-915a-1b640c108d44 service nova] Creating event network-changed:fcb1af23-6be7-4f45-902c-9a55dd3796a8 for instance 2385f6eb-986f-4af3-84bd-a3df24c4aa3e on hv-cinder-80789 Sep 08 16:32:41.030690 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-d0ac77ab-b795-4423-9c4c-f9722df0f455 req-9cafdd4e-05fa-42e8-915a-1b640c108d44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042913 Sep 08 16:32:41.031296 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 513/1080] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:32:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:33:51.946523 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:33:51.947192 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:33:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:34:19.060684 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:34:19.061460 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:34:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:34:20.414386 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:34:20.415237 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:34:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:34:22.053081 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:22.054134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:22.054310 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: ERROR oslo.messaging._drivers.impl_rabbit [-] [daa093db-1928-42a4-9783-708bc6590c00] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 16:34:22.061126 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-ec878d2c-095c-4b82-bb66-e578a337dfbe req-be0e27a5-63b6-4cd6-a284-550d52dcf69e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2385f6eb-986f-4af3-84bd-a3df24c4aa3e", "tag": "fcb1af23-6be7-4f45-902c-9a55dd3796a8"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:34:22.064135 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:22.064447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:34:22.064447 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:34:22.065381 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:22.066746 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:22.067376 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:22.083164 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-ec878d2c-095c-4b82-bb66-e578a337dfbe req-be0e27a5-63b6-4cd6-a284-550d52dcf69e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:22.084084 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-ec878d2c-095c-4b82-bb66-e578a337dfbe req-be0e27a5-63b6-4cd6-a284-550d52dcf69e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:22.121975 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-ec878d2c-095c-4b82-bb66-e578a337dfbe req-be0e27a5-63b6-4cd6-a284-550d52dcf69e service nova] Creating event network-changed:fcb1af23-6be7-4f45-902c-9a55dd3796a8 for instance 2385f6eb-986f-4af3-84bd-a3df24c4aa3e on hv-cinder-80789 Sep 08 16:34:22.132776 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-ec878d2c-095c-4b82-bb66-e578a337dfbe req-be0e27a5-63b6-4cd6-a284-550d52dcf69e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081620 Sep 08 16:34:22.133716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 514/1081] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:34:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:34:22.145588 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:34:22.302004 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-3eb6615c-6e6c-4896-a41d-371492fd735e tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 204 len: 0 microversion: 2.1 time: 0.254237 Sep 08 16:34:22.303415 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 568/1082] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:34:22 2021] DELETE /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:34:22.314084 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:22.316140 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:22.333984 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:22.334266 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:22.335813 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:22.336678 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:22.947725 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:34:22.968920 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-865c4f0d-2c5f-470e-9d36-ff87e774640b tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1576 microversion: 2.1 time: 0.658733 Sep 08 16:34:22.970204 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 515/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:22 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1576 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:34:23.998125 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:23.998970 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:24.006738 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:24.007188 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:24.008005 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:24.008446 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:24.398110 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:34:24.407824 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-a95fb578-9437-46f3-a5d7-b086973c443a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1457 microversion: 2.1 time: 0.414186 Sep 08 16:34:24.423506 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 569/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:23 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1457 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:34:25.039314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-15663642-7ed6-462d-b0a9-7fc42ac9f319 req-dfa4cd9e-b569-4db5-93f3-55949f196183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2385f6eb-986f-4af3-84bd-a3df24c4aa3e", "name": "network-vif-deleted", "tag": "fcb1af23-6be7-4f45-902c-9a55dd3796a8"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:34:25.041333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:34:25.041333 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:34:25.063800 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-15663642-7ed6-462d-b0a9-7fc42ac9f319 req-dfa4cd9e-b569-4db5-93f3-55949f196183 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:25.064242 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-15663642-7ed6-462d-b0a9-7fc42ac9f319 req-dfa4cd9e-b569-4db5-93f3-55949f196183 service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:25.082921 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] [daa093db-1928-42a4-9783-708bc6590c00] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35982. Sep 08 16:34:25.085072 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-15663642-7ed6-462d-b0a9-7fc42ac9f319 req-dfa4cd9e-b569-4db5-93f3-55949f196183 service nova] Creating event network-vif-deleted:fcb1af23-6be7-4f45-902c-9a55dd3796a8 for instance 2385f6eb-986f-4af3-84bd-a3df24c4aa3e on hv-cinder-80789 Sep 08 16:34:25.090270 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-15663642-7ed6-462d-b0a9-7fc42ac9f319 req-dfa4cd9e-b569-4db5-93f3-55949f196183 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055023 Sep 08 16:34:25.090881 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 516/1085] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:34:25.434447 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:25.435143 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:25.445275 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:25.445790 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:25.446623 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:25.447312 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:25.612491 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:34:25.628954 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-fe550639-af00-477c-a6d7-80825345dd03 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 200 len: 1224 microversion: 2.1 time: 0.197894 Sep 08 16:34:25.630134 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 570/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:25 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 1224 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:34:26.731510 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:26.732609 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 2385f6eb-986f-4af3-84bd-a3df24c4aa3e] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:26.741431 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:26.741998 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:26.742898 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:26.743387 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:26.798350 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] HTTP exception thrown: Instance 2385f6eb-986f-4af3-84bd-a3df24c4aa3e could not be found. Sep 08 16:34:26.799057 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Returning 404 to user: Instance 2385f6eb-986f-4af3-84bd-a3df24c4aa3e could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:34:26.800815 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-9842731a-cb5b-4b89-ab5c-c52883e365bf tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e" status: 404 len: 111 microversion: 2.1 time: 0.073380 Sep 08 16:34:26.801487 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 517/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:26 2021] GET /compute/v2.1/servers/2385f6eb-986f-4af3-84bd-a3df24c4aa3e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:34:31.168625 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-9d263e6a-e7b3-41d6-b102-f78ffa161e55 req-d48b1a07-3deb-4a3b-9ce6-79f3fac8b72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeaf9531-64bb-417e-b012-6c266e39f8c2", "tag": "91d8ec70-f575-46bb-9d90-c08e8ef8bd3e"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:34:31.170230 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:34:31.170230 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:34:31.171840 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:31.172836 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:31.181149 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-9d263e6a-e7b3-41d6-b102-f78ffa161e55 req-d48b1a07-3deb-4a3b-9ce6-79f3fac8b72e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:31.181595 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-9d263e6a-e7b3-41d6-b102-f78ffa161e55 req-d48b1a07-3deb-4a3b-9ce6-79f3fac8b72e service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:31.188911 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:31.190363 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:31.192277 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:31.193528 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:31.200558 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-9d263e6a-e7b3-41d6-b102-f78ffa161e55 req-d48b1a07-3deb-4a3b-9ce6-79f3fac8b72e service nova] Creating event network-changed:91d8ec70-f575-46bb-9d90-c08e8ef8bd3e for instance aeaf9531-64bb-417e-b012-6c266e39f8c2 on hv-cinder-80789 Sep 08 16:34:31.206441 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-9d263e6a-e7b3-41d6-b102-f78ffa161e55 req-d48b1a07-3deb-4a3b-9ce6-79f3fac8b72e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040795 Sep 08 16:34:31.207372 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 518/1088] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:34:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:34:31.318282 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Going to try to terminate instance {{(pid=93618) delete /opt/stack/nova/nova/compute/api.py:2562}} Sep 08 16:34:31.491788 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9bf5d85b-17cb-4f28-a2af-71118679b2d5 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 204 len: 0 microversion: 2.1 time: 0.327822 Sep 08 16:34:31.492539 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 571/1089] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:34:31 2021] DELETE /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:34:31.508966 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:31.510205 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:31.525314 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:31.526128 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:31.527565 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:31.528351 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:31.994585 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.policy [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:34:32.007229 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-ddfa0ee1-dca3-452e-8a2e-7a68780f1725 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1576 microversion: 2.1 time: 0.507251 Sep 08 16:34:32.007869 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 519/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:31 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1576 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:34:33.028955 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:33.029760 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:33.037930 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:33.038416 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:33.039199 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:33.039665 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:33.414109 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:34:33.429436 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-1c5210c7-ef5b-4115-8824-dba30203ffe3 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1457 microversion: 2.1 time: 0.404241 Sep 08 16:34:33.430490 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 572/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:33 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1457 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:34:34.134797 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [req-21bc3f07-e2ae-43c8-9824-f7fe395e6e35 req-ae810d69-3f97-4e0c-9903-4b6e47c8e56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeaf9531-64bb-417e-b012-6c266e39f8c2", "name": "network-vif-deleted", "tag": "91d8ec70-f575-46bb-9d90-c08e8ef8bd3e"}]} {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:34:34.136708 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 16:34:34.136708 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: warnings.warn(msg) Sep 08 16:34:34.149045 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-21bc3f07-e2ae-43c8-9824-f7fe395e6e35 req-ae810d69-3f97-4e0c-9903-4b6e47c8e56b service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:34.149783 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [req-21bc3f07-e2ae-43c8-9824-f7fe395e6e35 req-ae810d69-3f97-4e0c-9903-4b6e47c8e56b service nova] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:34.171132 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.compute.server_external_events [req-21bc3f07-e2ae-43c8-9824-f7fe395e6e35 req-ae810d69-3f97-4e0c-9903-4b6e47c8e56b service nova] Creating event network-vif-deleted:91d8ec70-f575-46bb-9d90-c08e8ef8bd3e for instance aeaf9531-64bb-417e-b012-6c266e39f8c2 on hv-cinder-80789 Sep 08 16:34:34.178497 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [req-21bc3f07-e2ae-43c8-9824-f7fe395e6e35 req-ae810d69-3f97-4e0c-9903-4b6e47c8e56b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047731 Sep 08 16:34:34.179197 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 520/1092] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Sep 8 16:34:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:34:34.454617 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:34.455454 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:34.465410 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:34.466349 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:34.467377 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:34.467926 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:34.618614 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.policy [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a052e4aeda6d4a9ba527d49ba434d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48dfce1083d414da5ba06085d3813d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:34:34.628283 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-9db2bd15-bb70-4917-b6d9-eb319f88dbb9 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 200 len: 1224 microversion: 2.1 time: 0.177298 Sep 08 16:34:34.628944 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 573/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:34 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 1224 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:34:35.652918 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:35.653659 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: aeaf9531-64bb-417e-b012-6c266e39f8c2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:35.662579 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:35.663028 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:35.663868 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:35.664312 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:35.716401 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] HTTP exception thrown: Instance aeaf9531-64bb-417e-b012-6c266e39f8c2 could not be found. Sep 08 16:34:35.717018 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Returning 404 to user: Instance aeaf9531-64bb-417e-b012-6c266e39f8c2 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:34:35.717858 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-74496e76-5ff3-435a-9fb2-101c12db2460 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2" status: 404 len: 111 microversion: 2.1 time: 0.069170 Sep 08 16:34:35.718429 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 521/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:35 2021] GET /compute/v2.1/servers/aeaf9531-64bb-417e-b012-6c266e39f8c2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:34:36.893717 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:36.894614 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.compute.api [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93618) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:36.902563 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:36.903157 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:36.904058 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:36.904578 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG oslo_concurrency.lockutils [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:36.965426 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.wsgi [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] HTTP exception thrown: Instance 98a3ee99-83f9-4271-84e8-d09119947db2 could not be found. Sep 08 16:34:36.966071 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Returning 404 to user: Instance 98a3ee99-83f9-4271-84e8-d09119947db2 could not be found. {{(pid=93618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:34:36.966971 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-f55a52a4-399a-4947-894e-2f382096f523 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 404 len: 111 microversion: 2.1 time: 0.077867 Sep 08 16:34:36.967639 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 574/1095] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Sep 8 16:34:36 2021] DELETE /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:34:36.976742 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '>' {{(pid=93617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:36.977394 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.compute.api [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] [instance: 98a3ee99-83f9-4271-84e8-d09119947db2] Fetching instance by UUID {{(pid=93617) get /opt/stack/nova/nova/compute/api.py:2813}} Sep 08 16:34:36.986012 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:36.987065 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:36.987944 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 08 16:34:36.988426 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG oslo_concurrency.lockutils [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Lock "c4ff700c-997f-477c-8f3b-ea37e18991fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 08 16:34:37.042499 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.wsgi [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] HTTP exception thrown: Instance 98a3ee99-83f9-4271-84e8-d09119947db2 could not be found. Sep 08 16:34:37.043160 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: DEBUG nova.api.openstack.wsgi [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Returning 404 to user: Instance 98a3ee99-83f9-4271-84e8-d09119947db2 could not be found. {{(pid=93617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Sep 08 16:34:37.044347 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO nova.api.openstack.requestlog [None req-372e2462-768d-4dab-9490-2a3c3fab616a tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2" status: 404 len: 111 microversion: 2.1 time: 0.071109 Sep 08 16:34:37.045060 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: [pid: 93617|app: 0|req: 522/1096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Sep 8 16:34:36 2021] GET /compute/v2.1/servers/98a3ee99-83f9-4271-84e8-d09119947db2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:34:38.565264 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: DEBUG nova.api.openstack.wsgi [None req-b64bd558-6468-4703-9ab2-868da7b503c1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] Calling method '.version_select at 0x7f37044434c0>' {{(pid=93618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:34:38.594607 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO nova.api.openstack.requestlog [None req-b64bd558-6468-4703-9ab2-868da7b503c1 tempest-TestVolumeBootPattern-1389009660 tempest-TestVolumeBootPattern-1389009660-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-77182998" status: 202 len: 0 microversion: 2.1 time: 0.034323 Sep 08 16:34:38.595196 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: [pid: 93618|app: 0|req: 575/1097] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Sep 8 16:34:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-77182998 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:35:32.211060 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:35:32.211724 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:35:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:37:11.965687 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:37:11.966499 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:37:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:37:34.692716 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:37:34.693374 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:37:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:37:39.080341 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:37:39.081119 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:37:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:37:40.436336 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:37:40.437110 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:37:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:37:41.466156 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:37:41.466864 dv-cinder-807898-1-iscsi devstack@n-api.service[93618]: Wed Sep 8 16:37:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 08 16:38:52.230298 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:38:52.231046 dv-cinder-807898-1-iscsi devstack@n-api.service[93617]: Wed Sep 8 16:38:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!